-- Logs begin at Tue 2022-08-30 00:15:21 UTC, end at Tue 2022-08-30 01:21:38 UTC. -- Aug 30 00:48:11.633309 dv-cinder-815145-12-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 00:48:11.643022 dv-cinder-815145-12-smb devstack@keystone.service[81459]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:48:11 2022] *** Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: nodename: dv-cinder-815145-12-smb Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: machine: x86_64 Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: clock source: unix Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: pcre jit disabled Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: detected number of CPU cores: 4 Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: current working directory: / Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: your processes number limit is 47680 Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: your memory page size is 4096 bytes Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: detected max file descriptor number: 2048 Aug 30 00:48:11.645085 dv-cinder-815145-12-smb devstack@keystone.service[81459]: lock engine: pthread robust mutexes Aug 30 00:48:11.645979 dv-cinder-815145-12-smb devstack@keystone.service[81459]: thunder lock: enabled Aug 30 00:48:11.645979 dv-cinder-815145-12-smb devstack@keystone.service[81459]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 00:48:11.645979 dv-cinder-815145-12-smb devstack@keystone.service[81459]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:48:11.686774 dv-cinder-815145-12-smb devstack@keystone.service[81459]: Python main interpreter initialized at 0x55cbd2a699c0 Aug 30 00:48:11.686774 dv-cinder-815145-12-smb devstack@keystone.service[81459]: python threads support enabled Aug 30 00:48:11.686774 dv-cinder-815145-12-smb devstack@keystone.service[81459]: your server socket listen backlog is limited to 100 connections Aug 30 00:48:11.686774 dv-cinder-815145-12-smb devstack@keystone.service[81459]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:48:11.687132 dv-cinder-815145-12-smb devstack@keystone.service[81459]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:48:11.687213 dv-cinder-815145-12-smb devstack@keystone.service[81459]: *** Operational MODE: preforking *** Aug 30 00:48:11.687453 dv-cinder-815145-12-smb devstack@keystone.service[81459]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:48:11.687453 dv-cinder-815145-12-smb devstack@keystone.service[81459]: spawned uWSGI master process (pid: 81459) Aug 30 00:48:11.687666 dv-cinder-815145-12-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 00:48:11.688185 dv-cinder-815145-12-smb devstack@keystone.service[81459]: spawned uWSGI worker 1 (pid: 81472, cores: 1) Aug 30 00:48:11.688522 dv-cinder-815145-12-smb devstack@keystone.service[81459]: spawned uWSGI worker 2 (pid: 81473, cores: 1) Aug 30 00:48:11.688675 dv-cinder-815145-12-smb devstack@keystone.service[81459]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:48:15.933016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:48:15.933016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: from cryptography.utils import int_from_bytes Aug 30 00:48:15.933835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:48:15.933835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: from cryptography.utils import int_from_bytes Aug 30 00:48:15.937453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:48:15.937453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Aug 30 00:48:15.937955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:48:15.937955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Aug 30 00:48:15.983022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:48:15.983255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:48:15.983412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] command line args: [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:48:15.983681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:48:15.983817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ================================================================================ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:48:15.984093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] admin_token = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.984343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config_dir = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.984589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.984750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config_source = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.985027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] debug = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.985229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.985570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.985775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.986022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.986254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.986639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.986639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_config_append = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.986859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.986975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_dir = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.987070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:48:15.987219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.987322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:48:15.987436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.987545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] command line args: [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:48:15.987671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.987748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:48:15.987820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.987937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ================================================================================ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:48:15.988064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_dir = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_source = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.988920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] debug = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.989987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_config_append = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.990999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_dir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991228 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] publish_errors = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.991992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.992415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.992537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.992625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.992740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.992887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] standard_threads = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.992970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993198 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_journal = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_json = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_stderr = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.993944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.994037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_syslog = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.994132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.994282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.994361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.994532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.994618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.994761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.994846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.995014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.995246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.995330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.995466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] publish_errors = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.995601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.995683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.995755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.995909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.995994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.996072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.996154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.996315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.996393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.996547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.996631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.996779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] standard_threads = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.997011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.997311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.997563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.997644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.997797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.997876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.997997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.998083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.998177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_journal = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.998277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.998362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_json = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.998512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.998600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_stderr = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.998682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_syslog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.998752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.998902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:48:15.998985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:15.999981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.000933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.001855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.002927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.003931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.004994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.005999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.006995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.007986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.008928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.009917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.010975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.011984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.012140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.012218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.012370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.012450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.012627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.012707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.012887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.013122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.013345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.013426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.013605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.013691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.013802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.013881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.014974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.015989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.016926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.017992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.018932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.external = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.019941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.020144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.020278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.020357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.020530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.020618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.password = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.020773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.020874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.token = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.021960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.022957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.023898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.024945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.external = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.025993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.password = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.token = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.026929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.027930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.028101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.028209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.028366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.028552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.028631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.028991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.029956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.030903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.031876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.032970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.033941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.034917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.035964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.036938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.037931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.038850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.039933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.040909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.041995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.042937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.043881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.044222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.044370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.044549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.044631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.044818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.044913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.045849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.046932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.047955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.048903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.049938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.050869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.051993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.052987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.053917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.054875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.055943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.056897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.057869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.058963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.059042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.059187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.059277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.059590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.059664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.059777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.060993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.061911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.062850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.063965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.064981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.065953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.066885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.067947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.068988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.069967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:48:16.070112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.070396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.070642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.070891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.071132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.071369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.071602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.071847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.072132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.072361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.072601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.072886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.073150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.073407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.073640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.073877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.074116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.074349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.074583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.074816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.075132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.075730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.075975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.076223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.076463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.076715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.076976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.077222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.077451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.077691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.077933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:48:16.078101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:48:16.099420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.099641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.099863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.104263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.104507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.104725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.108255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.113349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.136459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.136666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.141120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.141344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.189513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.190477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.237778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.237969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.240560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.240823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.396334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.396520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.396695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.396884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.397415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.397632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.402618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.402869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.403050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.403497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.404057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.404284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.420657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.420914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.421138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.421369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.421661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.421877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.422082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.422207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.422420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.422646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.422872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.423081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.423282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.423497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.433211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.433846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.446207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.446417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.446548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.446643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.446724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.446888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.446983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.447100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.447199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.447327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.447450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.447574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.447697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.447697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:48:16.464501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.464736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:48:16.464862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.465000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:48:16.465124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.465266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:48:16.465393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.465522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:48:16.465611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.465837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.466038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.466124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.466336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.467192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.467725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.467990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.475819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.476092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.476359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.476636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.477446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.477730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.477993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.478273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.483593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.486211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.486444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.486755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.487033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.487310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.487587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.487847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.488112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.488376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.488645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.488939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.489122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.489277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.489408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.489634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.489913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.490192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.490455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.490730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.491002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.491379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.491656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.491925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.511950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.513525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.513811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.516184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.517762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.518047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.518325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.518611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.518889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.522763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.523060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.523340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.525368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.525657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.529591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.529877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.530160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.530478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.530701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.530836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.531003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.532987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.533290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.533570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.535219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.535518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.535801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.536080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.536358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.536620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.536919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.537187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.551890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.552203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.555363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.555631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.556054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.559152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.559472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.559923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.563617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.563755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.563896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.566879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.568295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.569925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.570228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.570509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.570791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.571072 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.571447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.571589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.574681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.575078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.575832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.576132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.576406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.576687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.587128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.587415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.587681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.587945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.592964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.593254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.593521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.593782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.594763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.596392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.597937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.598212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.600602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.600837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.601133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.601425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.601690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.601976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.602145 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.603677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.603951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.607191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.607476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.607878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.608166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.608462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.613184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.613465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.613743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.614021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.614301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.614571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.614852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.619997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.620284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.620659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.620963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.621249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.621525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.621863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.630389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.633409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.636281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.637616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.637854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.639306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.639583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.639875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.641063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.643949 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.645581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.646904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.647162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.647455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.647745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.648295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.651151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.651438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.651729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.652003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.654163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.655622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.658651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.658959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.659247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.659526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.659887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.660173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.660452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.667513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.667801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.668076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.668224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.668314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.668409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.668583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.668687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.669213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.669572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.669863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.670138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.670407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.670676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.670933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.671207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.671475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.676057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:48:16.676339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.676623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.676912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.677188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.677551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.677740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.678010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.678289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.678557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.678821 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.679076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.679342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.679610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:48:16.705689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbd2a699c0 pid: 81473 (default app) Aug 30 00:48:16.709277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a75b8-ac07-4503-951d-c171420d3403 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:16.709568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a75b8-ac07-4503-951d-c171420d3403 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:16.709830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a75b8-ac07-4503-951d-c171420d3403 None None] PATH_INFO: `/v3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:16.714027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 791 bytes} [Tue Aug 30 00:48:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:16.714694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbd2a699c0 pid: 81472 (default app) Aug 30 00:48:23.420273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a317-3769-4f64-b58e-63bf9858bf40 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:23.420971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a317-3769-4f64-b58e-63bf9858bf40 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:23.420971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a317-3769-4f64-b58e-63bf9858bf40 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:23.422147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 2/2] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:23.432022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:23.432780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:23.433042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:23.504963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: INFO dbcounter [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] Registered counter for database keystone Aug 30 00:48:23.526003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG oslo_db.sqlalchemy.engines [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:48:23.537820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writer thread running {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:48:23.730030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81472) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:48:23.730313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81472) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:48:23.791649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:23.794278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:23.940630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1/3] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 00:48:24.419702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6a317-3769-4f64-b58e-63bf9858bf40 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:24.489481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: INFO dbcounter [None req-5cf6a317-3769-4f64-b58e-63bf9858bf40 None None] Registered counter for database keystone Aug 30 00:48:24.514966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf6a317-3769-4f64-b58e-63bf9858bf40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:48:24.527294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writer thread running {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:48:24.649497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6a317-3769-4f64-b58e-63bf9858bf40 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:24.655421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ded88f-af07-4a8f-b030-d886c34300b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:24.656089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded88f-af07-4a8f-b030-d886c34300b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:24.656366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded88f-af07-4a8f-b030-d886c34300b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:24.656638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded88f-af07-4a8f-b030-d886c34300b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:24.666029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ded88f-af07-4a8f-b030-d886c34300b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:24.719796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e1ded88f-af07-4a8f-b030-d886c34300b1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:48:24.720065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ded88f-af07-4a8f-b030-d886c34300b1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:24.730507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 3/4] 10.222.0.89 () {58 vars in 1324 bytes} [Tue Aug 30 00:48:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:48:24.740592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:24.764649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae5d84-cb60-4e18-a083-b7e38d886745 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:24.770937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6aa94-1274-47de-bed7-bfad94661ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:24.772115 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6aa94-1274-47de-bed7-bfad94661ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:24.772400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6aa94-1274-47de-bed7-bfad94661ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:24.772677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6aa94-1274-47de-bed7-bfad94661ee7 admin admin] PATH_INFO: `/v3/projects/b2882d1c77544239bfa08e78d60c1fc1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:24.774376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6aa94-1274-47de-bed7-bfad94661ee7 admin admin] RBAC: Authorizing `identity:get_project(project_id=b2882d1c77544239bfa08e78d60c1fc1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:24.827085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING keystone.common.rbac_enforcer.enforcer [None req-24d6aa94-1274-47de-bed7-bfad94661ee7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:48:24.827410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6aa94-1274-47de-bed7-bfad94661ee7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:24.832064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 2/5] 10.222.0.89 () {56 vars in 1207 bytes} [Tue Aug 30 00:48:24 2022] GET /identity/v3/projects/b2882d1c77544239bfa08e78d60c1fc1 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:26.826622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe248be-f8b4-40db-9c8e-276c228b8ef7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:26.827179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe248be-f8b4-40db-9c8e-276c228b8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:26.827179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe248be-f8b4-40db-9c8e-276c228b8ef7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:26.834356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 4/6] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:26.843877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2d6b-1ba6-4c24-9b11-56634c966424 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:26.844367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2d6b-1ba6-4c24-9b11-56634c966424 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:26.844367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2d6b-1ba6-4c24-9b11-56634c966424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:26.866607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fa5c2d6b-1ba6-4c24-9b11-56634c966424 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:26.868410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa5c2d6b-1ba6-4c24-9b11-56634c966424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:26.877581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 3/7] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 00:48:27.137846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe248be-f8b4-40db-9c8e-276c228b8ef7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:27.158938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe248be-f8b4-40db-9c8e-276c228b8ef7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:27.164458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aab69-728a-4a44-ab95-8ffb34bae603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:27.165098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aab69-728a-4a44-ab95-8ffb34bae603 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:27.165385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aab69-728a-4a44-ab95-8ffb34bae603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:27.165646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aab69-728a-4a44-ab95-8ffb34bae603 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:27.174642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aab69-728a-4a44-ab95-8ffb34bae603 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:27.176507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aab69-728a-4a44-ab95-8ffb34bae603 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:27.186185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 5/8] 10.222.0.89 () {58 vars in 1324 bytes} [Tue Aug 30 00:48:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:48:27.191705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2d6b-1ba6-4c24-9b11-56634c966424 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:27.201802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2d6b-1ba6-4c24-9b11-56634c966424 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:27.206984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca273032-54af-48cf-b9fd-900cd6eab9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:27.207607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca273032-54af-48cf-b9fd-900cd6eab9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:27.207880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca273032-54af-48cf-b9fd-900cd6eab9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:27.208147 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca273032-54af-48cf-b9fd-900cd6eab9b1 admin admin] PATH_INFO: `/v3/users/ed9887c2ab9944d2a1b8d085a3861143` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:27.209627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca273032-54af-48cf-b9fd-900cd6eab9b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed9887c2ab9944d2a1b8d085a3861143)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:27.211447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca273032-54af-48cf-b9fd-900cd6eab9b1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:27.213084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 4/9] 10.222.0.89 () {56 vars in 1198 bytes} [Tue Aug 30 00:48:27 2022] GET /identity/v3/users/ed9887c2ab9944d2a1b8d085a3861143 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:29.163719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a938f-81ea-4bf6-9024-6a92b7a22652 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:29.164255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a938f-81ea-4bf6-9024-6a92b7a22652 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:29.164255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a938f-81ea-4bf6-9024-6a92b7a22652 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:29.165640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 6/10] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:29.170971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f73dd-cb4f-479a-834d-91460c606a2d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:29.171793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f73dd-cb4f-479a-834d-91460c606a2d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:29.172066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f73dd-cb4f-479a-834d-91460c606a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:29.190864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e4f73dd-cb4f-479a-834d-91460c606a2d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:29.192033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e4f73dd-cb4f-479a-834d-91460c606a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:29.249952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0073b-3a2a-4d3b-9a6b-9528116de08a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:29.250187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0073b-3a2a-4d3b-9a6b-9528116de08a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:29.250562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0073b-3a2a-4d3b-9a6b-9528116de08a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:29.252158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 7/11] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:29.257871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:29.258274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:29.258779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:29.286959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 5/12] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:29.309094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG passlib.handlers.bcrypt [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81473) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:48:29.309482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG passlib.handlers.bcrypt [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81473) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:48:29.358129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:29.359656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:29.462533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 8/13] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:29.565196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f73dd-cb4f-479a-834d-91460c606a2d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:29.592044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:29.678579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f73dd-cb4f-479a-834d-91460c606a2d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:29.714771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:29.715349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:29.715630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:29.716061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:29.728044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:29.730678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:29.737250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:29.738249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:29.739054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 6/14] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:29.749759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:29.828362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:29.834734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b8a1e-e65f-43d9-b6c8-80df870ce4a3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:29.837079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:29.847508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ee86f-0b05-49f2-9c01-14a739b30bd1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:29.873592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:29.874472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:29.874751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:29.875018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:29.882337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:29.882979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:29.883255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:29.883528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:29.884209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:29.884506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:29.885946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:29.897905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 7/15] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:29.903855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:29.943064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:29.944789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:30.004734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1866679-b0a3-4afd-98f8-fcd583fa1145 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:30.040920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:30.041553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:30.041917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:30.042103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] PATH_INFO: `/v3/users/ed9887c2ab9944d2a1b8d085a3861143` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:30.043261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] RBAC: Authorizing `identity:get_user(user_id=ed9887c2ab9944d2a1b8d085a3861143)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:30.045209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:30.046594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 9/16] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:30.046835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 8/17] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:29 2022] GET /identity/v3/users/ed9887c2ab9944d2a1b8d085a3861143 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:30.052981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:30.053124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:30.057854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:30.068963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:30.156866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37c3c8-3a7c-4810-8cd6-2b3e12a39159 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:30.157303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca2c5-42b1-4d04-9533-f845fdafdf55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:30.192325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:30.192963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:30.193343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:30.193449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:30.193541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:30.193620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:30.193820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:30.193946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:30.195168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:30.196651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:30.198297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 10/18] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:30.204765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:30.206532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:30.208138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:48:30.224650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:30.225641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:48:30.226466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:48:30.226466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:48:30.226466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:30.226466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 9/19] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:48:30.232860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:30.280876 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:30.296907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:30.312784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b39135-07f0-4529-b99f-910fdb47bfbf None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:30.336208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416742b-4600-479e-bceb-7e4ea0ca8cf6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:30.351239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c31a4-6182-4c8c-a1f8-cd087aafe6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:30.351959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c31a4-6182-4c8c-a1f8-cd087aafe6ac None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:30.352265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c31a4-6182-4c8c-a1f8-cd087aafe6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:30.352538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c31a4-6182-4c8c-a1f8-cd087aafe6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:30.353371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c31a4-6182-4c8c-a1f8-cd087aafe6ac None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.domain.id=default, user.id=ed9887c2ab9944d2a1b8d085a3861143) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:30.353703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c31a4-6182-4c8c-a1f8-cd087aafe6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:30.355271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c31a4-6182-4c8c-a1f8-cd087aafe6ac None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:30.365786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 11/20] 10.222.0.89 () {56 vars in 1322 bytes} [Tue Aug 30 00:48:30 2022] GET /identity/v3/role_assignments?user.id=ed9887c2ab9944d2a1b8d085a3861143&scope.domain.id=default&role.id=a456b12493c0413b825ef135c49a3338 => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:30.376588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77044b92-96aa-4317-9924-e676c700f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:30.377272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77044b92-96aa-4317-9924-e676c700f020 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:30.377544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77044b92-96aa-4317-9924-e676c700f020 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:30.377814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77044b92-96aa-4317-9924-e676c700f020 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:30.378486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77044b92-96aa-4317-9924-e676c700f020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:30.378794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77044b92-96aa-4317-9924-e676c700f020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:30.380239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77044b92-96aa-4317-9924-e676c700f020 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:30.401867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 10/21] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:32.688606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35deb88-9ff9-47cb-ba3c-514e3ac8d266 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:32.689150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35deb88-9ff9-47cb-ba3c-514e3ac8d266 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:32.689223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35deb88-9ff9-47cb-ba3c-514e3ac8d266 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:32.690798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 12/22] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:32.695880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1a98a-d1be-4740-808d-ff96b11f4c96 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:32.696289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1a98a-d1be-4740-808d-ff96b11f4c96 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:32.696491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1a98a-d1be-4740-808d-ff96b11f4c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:32.725935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5fa1a98a-d1be-4740-808d-ff96b11f4c96 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:32.727243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5fa1a98a-d1be-4740-808d-ff96b11f4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:32.816830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c8727-a377-4f16-8250-b4daead9ea00 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:32.816830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c8727-a377-4f16-8250-b4daead9ea00 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:32.816830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c8727-a377-4f16-8250-b4daead9ea00 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:32.816830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 13/23] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:32.822006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1f5f-74c3-4e6c-8904-aadb592ee97c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:32.822535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1f5f-74c3-4e6c-8904-aadb592ee97c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:32.823033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d1f5f-74c3-4e6c-8904-aadb592ee97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:32.833852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 11/24] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:32.862017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3c3d1f5f-74c3-4e6c-8904-aadb592ee97c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:32.863619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3c3d1f5f-74c3-4e6c-8904-aadb592ee97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:32.946235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86a68-09cb-4ac4-a8f9-95b4f6b6a0ee None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:32.946857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86a68-09cb-4ac4-a8f9-95b4f6b6a0ee None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:32.947805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86a68-09cb-4ac4-a8f9-95b4f6b6a0ee None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:32.949501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 12/25] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:48:32.955317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c52ad5-1563-4110-8fb8-3598de652e19 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:32.955991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c52ad5-1563-4110-8fb8-3598de652e19 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:32.956860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c52ad5-1563-4110-8fb8-3598de652e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:32.971288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 14/26] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:32.989089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-47c52ad5-1563-4110-8fb8-3598de652e19 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:32.990750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-47c52ad5-1563-4110-8fb8-3598de652e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:33.053317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:33.079091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 13/27] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:33.326369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d1f5f-74c3-4e6c-8904-aadb592ee97c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:33.329051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c52ad5-1563-4110-8fb8-3598de652e19 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:33.477256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:33.484680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c52ad5-1563-4110-8fb8-3598de652e19 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:33.500940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d1f5f-74c3-4e6c-8904-aadb592ee97c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:33.521955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbde92-9781-4167-ac4f-cb66b90e5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:33.522834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbde92-9781-4167-ac4f-cb66b90e5bad None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:33.523667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbde92-9781-4167-ac4f-cb66b90e5bad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:33.524088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbde92-9781-4167-ac4f-cb66b90e5bad None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:33.525233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbde92-9781-4167-ac4f-cb66b90e5bad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:33.527260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbde92-9781-4167-ac4f-cb66b90e5bad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:33.538857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:33.539662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:33.539997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:33.540293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:33.561500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:33.563189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:48:33.583275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:33.584144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:48:33.585006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:48:33.585006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:48:33.585006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:33.585006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 15/28] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:33.585224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:33.674725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 14/29] 10.222.0.89 () {60 vars in 1131 bytes} [Tue Aug 30 00:48:33 2022] POST /identity/v3/roles => generated 219 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:48:33.682839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f13e-161c-44eb-99b4-38d4b00ec0ff None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:33.683222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f13e-161c-44eb-99b4-38d4b00ec0ff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:33.683595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f13e-161c-44eb-99b4-38d4b00ec0ff None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:33.689512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 15/30] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:33.690557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641f13e-161c-44eb-99b4-38d4b00ec0ff None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:33.705463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9d3d6-d8f4-464a-b4ab-ba80c3322304 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:33.757319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:33.762764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828854d2-1a41-4935-b9f8-fd8447c5041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:33.763657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828854d2-1a41-4935-b9f8-fd8447c5041f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:33.764072 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828854d2-1a41-4935-b9f8-fd8447c5041f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:33.764510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828854d2-1a41-4935-b9f8-fd8447c5041f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:33.780323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828854d2-1a41-4935-b9f8-fd8447c5041f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-828854d2-1a41-4935-b9f8-fd8447c5041f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:33.787316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:33.788337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:33.789271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:33.791639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 16/31] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:48:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:33.793619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b5ea-7501-4dc9-84f8-df4e78eca4eb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:33.794089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b5ea-7501-4dc9-84f8-df4e78eca4eb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:33.794492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b5ea-7501-4dc9-84f8-df4e78eca4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:33.816748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0689b5ea-7501-4dc9-84f8-df4e78eca4eb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:33.818470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0689b5ea-7501-4dc9-84f8-df4e78eca4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:33.847445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:33.909572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 17/32] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:33.910925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b5ea-7501-4dc9-84f8-df4e78eca4eb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:33.969536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641f13e-161c-44eb-99b4-38d4b00ec0ff None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.025347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b5ea-7501-4dc9-84f8-df4e78eca4eb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.038913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:34.069472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33719de6-e544-4b3b-8ce6-4c7bcbe1ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:34.070406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33719de6-e544-4b3b-8ce6-4c7bcbe1ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.070544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:34.070966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33719de6-e544-4b3b-8ce6-4c7bcbe1ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.071121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.071407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33719de6-e544-4b3b-8ce6-4c7bcbe1ffc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.071746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.072358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:34.072664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:34.072840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33719de6-e544-4b3b-8ce6-4c7bcbe1ffc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:34.073271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33719de6-e544-4b3b-8ce6-4c7bcbe1ffc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:34.074331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:34.075027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33719de6-e544-4b3b-8ce6-4c7bcbe1ffc7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:34.090108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 18/33] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:34.090512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 16/34] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:34.091943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec70e-8f96-4e24-8e2e-c4e76a882734 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.096859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec70e-8f96-4e24-8e2e-c4e76a882734 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.096859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec70e-8f96-4e24-8e2e-c4e76a882734 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.096859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 19/35] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:34.098513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:34.099036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eec70e-8f96-4e24-8e2e-c4e76a882734 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:34.222484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac5d37-3246-43fd-b0a7-c30274eadfaa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.223582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eec70e-8f96-4e24-8e2e-c4e76a882734 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.225006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:34.260702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:34.261403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.261728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.262003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.262712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:34.264604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:34.265786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114792fb-5687-48b1-a66c-54803cb8ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:34.266460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114792fb-5687-48b1-a66c-54803cb8ee96 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.266738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114792fb-5687-48b1-a66c-54803cb8ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.267009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114792fb-5687-48b1-a66c-54803cb8ee96 None admin] PATH_INFO: `/v3/users/ed9887c2ab9944d2a1b8d085a3861143` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.268395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114792fb-5687-48b1-a66c-54803cb8ee96 None admin] RBAC: Authorizing `identity:get_user(user_id=ed9887c2ab9944d2a1b8d085a3861143)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:34.269903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114792fb-5687-48b1-a66c-54803cb8ee96 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:34.271570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 20/36] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:34 2022] GET /identity/v3/users/ed9887c2ab9944d2a1b8d085a3861143 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:34.272768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c18102-638d-4ed5-9e90-f0ae0e574b96 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.273075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c18102-638d-4ed5-9e90-f0ae0e574b96 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.273351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c18102-638d-4ed5-9e90-f0ae0e574b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.293853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b6c18102-638d-4ed5-9e90-f0ae0e574b96 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:34.295228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b6c18102-638d-4ed5-9e90-f0ae0e574b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:34.304848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 17/37] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:48:34 2022] POST /identity/v3/projects => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:48:34.304848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:34.339709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:34.394190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 21/38] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:34.395086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c18102-638d-4ed5-9e90-f0ae0e574b96 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:34.425705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f004a8-aea4-499f-9ae0-e50e1604a220 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.468756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640a7ef-ef49-49f0-a2a7-ac11266ae84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:34.469461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a7ef-ef49-49f0-a2a7-ac11266ae84f None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.469810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a7ef-ef49-49f0-a2a7-ac11266ae84f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.470003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a7ef-ef49-49f0-a2a7-ac11266ae84f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.470719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640a7ef-ef49-49f0-a2a7-ac11266ae84f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:34.472974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640a7ef-ef49-49f0-a2a7-ac11266ae84f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:34.491775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 18/39] 10.222.0.89 () {60 vars in 1131 bytes} [Tue Aug 30 00:48:34 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:48:34.494009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c606-161b-4927-8087-48ec314b4cf2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.494356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c606-161b-4927-8087-48ec314b4cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.494636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c606-161b-4927-8087-48ec314b4cf2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.495869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 19/40] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:34.504832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9637cf-fa5e-459b-a0a6-5f498a5f4288 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.504832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9637cf-fa5e-459b-a0a6-5f498a5f4288 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.508762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9637cf-fa5e-459b-a0a6-5f498a5f4288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.529892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2c9637cf-fa5e-459b-a0a6-5f498a5f4288 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:34.531615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c9637cf-fa5e-459b-a0a6-5f498a5f4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:34.535735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c18102-638d-4ed5-9e90-f0ae0e574b96 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.553226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:34.578258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:34.579211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.579443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.579712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.580975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:34.582624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:34.584446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 22/41] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:34.590626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:34.621815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 20/42] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:34.657652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:34.713323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c58b-0d7f-4e0d-83f8-5b51211103b0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.713954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9637cf-fa5e-459b-a0a6-5f498a5f4288 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:34.759155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:34.759949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:34.760239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:34.760515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] PATH_INFO: `/v3/domains/default/users/ed9887c2ab9944d2a1b8d085a3861143/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:34.762933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ed9887c2ab9944d2a1b8d085a3861143, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:34.765422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:34.843049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9637cf-fa5e-459b-a0a6-5f498a5f4288 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:34.893334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 23/43] 10.222.0.89 () {58 vars in 1361 bytes} [Tue Aug 30 00:48:34 2022] PUT /identity/v3/domains/default/users/ed9887c2ab9944d2a1b8d085a3861143/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:34.915557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:35.010480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:35.011455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:35.011740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:35.012170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:35.013236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:35.015138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:35.029553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:35.038182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6579b3-b6ac-4c01-ab53-39335addf7fd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:35.044211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 21/44] 10.222.0.89 () {60 vars in 1131 bytes} [Tue Aug 30 00:48:34 2022] POST /identity/v3/roles => generated 223 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:48:35.082765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa77a2-76fe-4961-b946-bf83f4b3496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:35.083457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa77a2-76fe-4961-b946-bf83f4b3496f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:35.083742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa77a2-76fe-4961-b946-bf83f4b3496f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:35.084016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa77a2-76fe-4961-b946-bf83f4b3496f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:35.085415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa77a2-76fe-4961-b946-bf83f4b3496f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:35.087172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa77a2-76fe-4961-b946-bf83f4b3496f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:35.092842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 24/45] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:35.097967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:35.108924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:35.217516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405e20e-97a3-41d9-8354-d31614385007 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:35.256163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30033c49-33d5-456a-865b-236db2f7c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:35.256819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033c49-33d5-456a-865b-236db2f7c5fb None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:35.257115 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033c49-33d5-456a-865b-236db2f7c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:35.257400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033c49-33d5-456a-865b-236db2f7c5fb None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:35.258084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30033c49-33d5-456a-865b-236db2f7c5fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:35.259655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30033c49-33d5-456a-865b-236db2f7c5fb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:35.287590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 22/46] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:48:35 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:48:36.902290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cdd42-638c-4776-a768-3c652ad28a82 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:36.902839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cdd42-638c-4776-a768-3c652ad28a82 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:36.902839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cdd42-638c-4776-a768-3c652ad28a82 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:36.904275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 25/47] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:36.909823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9616-02dc-476b-8cda-64e27d606ec4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:36.910210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9616-02dc-476b-8cda-64e27d606ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:36.910448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9616-02dc-476b-8cda-64e27d606ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:36.930078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6b7f9616-02dc-476b-8cda-64e27d606ec4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:36.931269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6b7f9616-02dc-476b-8cda-64e27d606ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:36.986226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:37.001868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 23/48] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:37.217483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bf4fd-44db-4153-9193-0fbb162c1113 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.217717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bf4fd-44db-4153-9193-0fbb162c1113 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.218021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bf4fd-44db-4153-9193-0fbb162c1113 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.219354 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 26/49] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:37.224670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83bce-259c-4047-8e9f-7973b797988c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.224989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83bce-259c-4047-8e9f-7973b797988c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.225440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83bce-259c-4047-8e9f-7973b797988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.245243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-beb83bce-259c-4047-8e9f-7973b797988c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:37.246446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-beb83bce-259c-4047-8e9f-7973b797988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:37.265297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bf4fd-44db-4153-9193-0fbb162c1113 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:37.319873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 24/50] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:37.371073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bf4fd-44db-4153-9193-0fbb162c1113 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:37.406092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:37.406721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.406999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.407268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.417987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:37.423221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:37.424255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:37.425233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:37.429182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 27/51] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:48:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:37.430386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb83bce-259c-4047-8e9f-7973b797988c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:37.542892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb83bce-259c-4047-8e9f-7973b797988c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:37.561343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:37.578546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:37.579165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.579445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.579734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.580426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:37.580726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:37.582163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:37.590398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 25/52] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:37.596161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:37.623633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:37.625257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:37.704745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd438d-3fc4-4284-929b-b0d78d7db641 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:37.730088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8425ef-a6ea-4a68-a7e1-a0f1b8d9fa14 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:37.738258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:37.738894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.739172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.739446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] PATH_INFO: `/v3/users/ed9887c2ab9944d2a1b8d085a3861143` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.741048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed9887c2ab9944d2a1b8d085a3861143)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:37.742505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:37.749130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 28/53] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:37 2022] GET /identity/v3/users/ed9887c2ab9944d2a1b8d085a3861143 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:37.751995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:37.770459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bece7-be77-431e-9833-0733b601f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:37.771106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bece7-be77-431e-9833-0733b601f18f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.771387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bece7-be77-431e-9833-0733b601f18f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.771651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bece7-be77-431e-9833-0733b601f18f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.772863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bece7-be77-431e-9833-0733b601f18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:37.774371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bece7-be77-431e-9833-0733b601f18f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:37.775937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 26/54] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:37.782097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bece7-be77-431e-9833-0733b601f18f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:37.832377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:37.846803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:37.855884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374384-e403-4197-bfc0-ab3cfa3999e7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:37.887020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bece7-be77-431e-9833-0733b601f18f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:37.890479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:37.891120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.891397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.891668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.892762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:37.894252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:37.896021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 29/55] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:37.901704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:37.922782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223d797-4793-40cb-a127-6264247418e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:37.923428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d797-4793-40cb-a127-6264247418e2 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:37.923707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d797-4793-40cb-a127-6264247418e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:37.923979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d797-4793-40cb-a127-6264247418e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:37.924660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223d797-4793-40cb-a127-6264247418e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:37.926168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223d797-4793-40cb-a127-6264247418e2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:37.953086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 27/56] 10.222.0.89 () {60 vars in 1140 bytes} [Tue Aug 30 00:48:37 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:48:38.010307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0aa304-1f85-4442-9c62-3be752ba01a3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:38.050500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89b80-7678-49c9-af7a-e7d291b6df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:38.051125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89b80-7678-49c9-af7a-e7d291b6df1d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:38.051406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89b80-7678-49c9-af7a-e7d291b6df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:38.051859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89b80-7678-49c9-af7a-e7d291b6df1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:38.052604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89b80-7678-49c9-af7a-e7d291b6df1d None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.domain.id=default, user.id=ed9887c2ab9944d2a1b8d085a3861143) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:38.052946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89b80-7678-49c9-af7a-e7d291b6df1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:38.054441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89b80-7678-49c9-af7a-e7d291b6df1d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:38.061556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 30/57] 10.222.0.89 () {56 vars in 1322 bytes} [Tue Aug 30 00:48:37 2022] GET /identity/v3/role_assignments?user.id=ed9887c2ab9944d2a1b8d085a3861143&scope.domain.id=default&role.id=a456b12493c0413b825ef135c49a3338 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:39.845606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799b87b-2df6-4737-a59c-eb482472f9be None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:39.846405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799b87b-2df6-4737-a59c-eb482472f9be None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:39.846521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799b87b-2df6-4737-a59c-eb482472f9be None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:39.848627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 28/58] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:39.854984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4ce5-cfe9-404f-8113-841b7926dd36 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:39.855726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4ce5-cfe9-404f-8113-841b7926dd36 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:39.855858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4ce5-cfe9-404f-8113-841b7926dd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:39.884083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-edcb4ce5-cfe9-404f-8113-841b7926dd36 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:39.885737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-edcb4ce5-cfe9-404f-8113-841b7926dd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:39.904673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:40.082352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 31/59] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:40.355039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799b87b-2df6-4737-a59c-eb482472f9be None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:40.461515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:40.466735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799b87b-2df6-4737-a59c-eb482472f9be None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:40.510129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b5b91-bb04-4b07-b89d-f9ab433c274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:40.510758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5b91-bb04-4b07-b89d-f9ab433c274e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:40.511034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5b91-bb04-4b07-b89d-f9ab433c274e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:40.511306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5b91-bb04-4b07-b89d-f9ab433c274e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:40.512461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b5b91-bb04-4b07-b89d-f9ab433c274e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:40.514528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b5b91-bb04-4b07-b89d-f9ab433c274e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:40.516076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 29/60] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:40.524912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4ce5-cfe9-404f-8113-841b7926dd36 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:40.644569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4ce5-cfe9-404f-8113-841b7926dd36 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:40.687602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dda415-9e28-4693-be7e-5deda7bad031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:40.688258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda415-9e28-4693-be7e-5deda7bad031 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:40.688542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda415-9e28-4693-be7e-5deda7bad031 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:40.688837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda415-9e28-4693-be7e-5deda7bad031 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:40.689543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dda415-9e28-4693-be7e-5deda7bad031 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:40.691096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dda415-9e28-4693-be7e-5deda7bad031 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:40.726338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 32/61] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:48:40 2022] POST /identity/v3/users => generated 275 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:48:43.710909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8e27-41b3-469e-b2ec-9276714cf6b7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:43.711424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8e27-41b3-469e-b2ec-9276714cf6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:43.711496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8e27-41b3-469e-b2ec-9276714cf6b7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:43.713096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 30/62] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:43.718409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78bbe5-d238-4393-bb76-51448c45e436 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:43.719255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78bbe5-d238-4393-bb76-51448c45e436 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:43.719727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78bbe5-d238-4393-bb76-51448c45e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:43.745826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4a78bbe5-d238-4393-bb76-51448c45e436 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:43.747602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4a78bbe5-d238-4393-bb76-51448c45e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:43.753769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:43.851662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 33/63] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:43.990165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996837cd-4eff-4ce9-8251-8f81bea942c5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:43.990778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996837cd-4eff-4ce9-8251-8f81bea942c5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:43.991271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996837cd-4eff-4ce9-8251-8f81bea942c5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:43.992893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 31/64] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:43.998866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eca8a-73ab-4700-ba0d-edcbe50e1815 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:43.999165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eca8a-73ab-4700-ba0d-edcbe50e1815 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:43.999446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eca8a-73ab-4700-ba0d-edcbe50e1815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.030615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4a2eca8a-73ab-4700-ba0d-edcbe50e1815 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:44.031826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4a2eca8a-73ab-4700-ba0d-edcbe50e1815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:44.092968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa3b2-5a82-4ea8-b402-33e6f27a2c95 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.093612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa3b2-5a82-4ea8-b402-33e6f27a2c95 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.094086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa3b2-5a82-4ea8-b402-33e6f27a2c95 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.095672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 32/65] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:48:44.100894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3f577-2162-4c6d-b877-58cafc350736 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.101322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3f577-2162-4c6d-b877-58cafc350736 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.101798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3f577-2162-4c6d-b877-58cafc350736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.132962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-61c3f577-2162-4c6d-b877-58cafc350736 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:44.134193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-61c3f577-2162-4c6d-b877-58cafc350736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:44.135696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 34/66] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:44.215619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 33/67] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:48:44.314040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86b41c-f488-4089-a986-26acad06ffe0 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.314647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86b41c-f488-4089-a986-26acad06ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.315115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86b41c-f488-4089-a986-26acad06ffe0 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.316843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 35/68] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:44.322388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59102a-7d31-4325-ae31-1d8893ec5f7a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.322921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59102a-7d31-4325-ae31-1d8893ec5f7a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.323384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59102a-7d31-4325-ae31-1d8893ec5f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.362077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e59102a-7d31-4325-ae31-1d8893ec5f7a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:44.363601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e59102a-7d31-4325-ae31-1d8893ec5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:44.368415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86b41c-f488-4089-a986-26acad06ffe0 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:44.461728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 34/69] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:48:44.463035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59102a-7d31-4325-ae31-1d8893ec5f7a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:44.470649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:44.498062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:44.525814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86b41c-f488-4089-a986-26acad06ffe0 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:44.562574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e580e79-0297-4fb3-a2c2-72a7b48df705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:44.563222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e580e79-0297-4fb3-a2c2-72a7b48df705 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.563504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e580e79-0297-4fb3-a2c2-72a7b48df705 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.563782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e580e79-0297-4fb3-a2c2-72a7b48df705 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.574425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e580e79-0297-4fb3-a2c2-72a7b48df705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:44.576352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59102a-7d31-4325-ae31-1d8893ec5f7a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2e580e79-0297-4fb3-a2c2-72a7b48df705 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:44.579596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:44.580570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:44.581510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:44.584949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 36/70] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:48:44.587440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875077-b2a1-4019-b0ce-00912b309b43 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.587737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875077-b2a1-4019-b0ce-00912b309b43 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.588018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875077-b2a1-4019-b0ce-00912b309b43 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.590025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 37/71] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:44.593531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875077-b2a1-4019-b0ce-00912b309b43 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:44.620305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:44.621055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.621340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.621844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.632204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:44.637104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:44.638025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 35/72] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:44.643996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:44.702137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875077-b2a1-4019-b0ce-00912b309b43 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:44.731497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:44.738089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298e92-0081-40c4-8c52-3fb3269e0762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:44.739147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298e92-0081-40c4-8c52-3fb3269e0762 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.739323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:44.739730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298e92-0081-40c4-8c52-3fb3269e0762 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.739800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298e92-0081-40c4-8c52-3fb3269e0762 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.752585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f524-2258-4568-9946-2c80523e209a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:44.756060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4298e92-0081-40c4-8c52-3fb3269e0762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-f4298e92-0081-40c4-8c52-3fb3269e0762 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:44.761343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:44.762209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:44.762987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:44.764065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 38/73] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:48:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:44.765824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19b141-952f-4d48-a999-b417c4c57355 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.766431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19b141-952f-4d48-a999-b417c4c57355 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.766717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19b141-952f-4d48-a999-b417c4c57355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.784923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9c19b141-952f-4d48-a999-b417c4c57355 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:44.786299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c19b141-952f-4d48-a999-b417c4c57355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:44.786461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:44.786915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.787188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.787452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.788115 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:44.788373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:44.789778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:44.798051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 36/74] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:44.798855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:44.853889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 39/75] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:44.861781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19b141-952f-4d48-a999-b417c4c57355 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:44.901486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80781e3c-14cf-4577-a7ef-49f453baaac8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:44.935735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:44.936401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:44.936680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:44.936983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:44.937666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:44.937968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:44.939349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:44.952597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 37/76] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:44.952597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:44.966553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:44.975905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19b141-952f-4d48-a999-b417c4c57355 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:44.998174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.014813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.015797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.016175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.016449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.027732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:45.032508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:45.033374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 40/77] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:45.037688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.065385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f247c1-9da5-4ab1-bcdb-27c026b2c2ef None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.100933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.101632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.101908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.102182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.102849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:45.103380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.104624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.117253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 38/78] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:48:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:45.119307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.143089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12603a-9577-4920-8f47-6ce8c96cbf98 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.178514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.179157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.179437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.179697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.196209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.197154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.197907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.199434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 41/79] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:45.204511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.224227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48fd25-7e2b-4301-9d62-335b91b11073 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.240347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.258721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.259386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.259668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.259946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] PATH_INFO: `/v3/users/ed9887c2ab9944d2a1b8d085a3861143` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.261115 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] RBAC: Authorizing `identity:get_user(user_id=ed9887c2ab9944d2a1b8d085a3861143)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.262635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.264462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 39/80] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/users/ed9887c2ab9944d2a1b8d085a3861143 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:45.265283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.302739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4b73-55ef-4bc0-aedd-c4365f373acd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.337901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.338523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.338801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.339073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.339735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:45.340037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.341546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.349827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 42/81] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:45.350486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.366733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33f50-e3b8-46d7-9813-a0d175643383 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.401919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.402581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.402870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.403147 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.404453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.405967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.407597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 40/82] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:45.408372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.420618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.452898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.455880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebb812-cbdd-412e-a6be-b3cb12273af6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.496321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.497154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.497522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.498011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.499200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.500661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.502289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 43/83] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:45.503055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.510916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1130-64b6-468f-bf59-54f453756061 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.544467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.545197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.545482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.545757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.604751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699458e-2792-4599-98d9-887f377ffd5d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.615765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.617880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.635517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.642049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.642689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.642970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.643247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.679284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.712604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.714124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.726679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 41/84] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:45.727594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.813678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 44/85] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:45.814553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.831310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93de9d9-af21-4ddb-942a-c9a34a0a868a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.842496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.867227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.867870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.868514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.868714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.869901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:45.871392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:45.873115 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 42/86] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:45.873878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:45.882850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:45.917818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa855cdc-1c8e-43d5-ac66-90698414cc06 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:45.956975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:45.957628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:45.957911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:45.958186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:45.978029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dba681-3584-4ad7-893a-7a6a2b0d96e1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.013638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.014253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.014535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.014775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.015437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.016953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.026486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.027962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.046994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 43/87] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:48:45 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:48:46.047957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.092945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:46.110438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:46.150997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 45/88] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:46.152196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.180510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaf330-4675-4c80-8359-64b182d2ed7b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.221856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.222508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.222794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.223066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.224236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.225761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.227417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 44/89] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:46.228654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.266477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18506860-71eb-4397-86f8-fe4e50af9f76 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.308082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.311061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.311061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.311061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.311061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.312689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.315092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 46/90] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:46.315831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.348539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d4afe-2567-41c9-b9b0-f8ca35b8c36c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.350468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:46.358968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:46.394114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.394996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.395462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.395878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.446495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baa54-621f-401a-9631-d6f9dfe673f5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.485720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.486169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.486952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.487436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.487672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.488110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.489781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.491633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.493930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 47/91] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:46.494890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.604024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d415e3-4e5b-4636-a153-2fd84dba94df None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.606472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:46.621839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 45/92] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:46.624426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.627991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:46.642509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.643262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.643540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.643809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.644548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=9d954de5ff0f4f03956c10acedd655bd) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:46.644874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.646837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.654306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 48/93] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/role_assignments?user.id=9d954de5ff0f4f03956c10acedd655bd&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:46.655215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.809880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43528-0b98-433e-a6c9-306a38ec7c89 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.855630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.856279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.856607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.856926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.857650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=ed9887c2ab9944d2a1b8d085a3861143) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:46.857954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.858227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eadb9f-b26d-4631-8983-ca2898b56124 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:46.859452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.869093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 46/94] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/role_assignments?user.id=ed9887c2ab9944d2a1b8d085a3861143&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:46.869939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:46.944257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:46.945313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:46.945790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:46.946316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:46.947404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] RBAC: Adding query filter params (role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=9d954de5ff0f4f03956c10acedd655bd) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:46.947929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:46.949647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:46.956831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:46.970057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 49/95] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/role_assignments?user.id=9d954de5ff0f4f03956c10acedd655bd&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=407978df648d44abb9a8aafed3b0793f => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:47.016893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3220a1-b6f2-4fd1-9a41-849d96eeb964 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:47.072340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43f676-d0ec-4ad3-bcf7-03c24ee3b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:47.073027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f676-d0ec-4ad3-bcf7-03c24ee3b005 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:47.073305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f676-d0ec-4ad3-bcf7-03c24ee3b005 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:47.073579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f676-d0ec-4ad3-bcf7-03c24ee3b005 None admin] PATH_INFO: `/v3/projects/b33b1839f2c34238867220c3b000af4d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:47.076321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43f676-d0ec-4ad3-bcf7-03c24ee3b005 None admin] RBAC: Authorizing `identity:get_project(project_id=b33b1839f2c34238867220c3b000af4d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:47.077661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43f676-d0ec-4ad3-bcf7-03c24ee3b005 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:47.079618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 47/96] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:46 2022] GET /identity/v3/projects/b33b1839f2c34238867220c3b000af4d => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:47.085810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:47.148378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:47.246089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42c9cb-a1ab-448c-82de-e805ad92d189 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:47.299779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262a73c-bb6b-4a88-8324-c30ae7da90f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:47.300323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262a73c-bb6b-4a88-8324-c30ae7da90f6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:47.300604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262a73c-bb6b-4a88-8324-c30ae7da90f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:47.300955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262a73c-bb6b-4a88-8324-c30ae7da90f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:47.301727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262a73c-bb6b-4a88-8324-c30ae7da90f6 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=b33b1839f2c34238867220c3b000af4d, user.id=9d954de5ff0f4f03956c10acedd655bd) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:47.302040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262a73c-bb6b-4a88-8324-c30ae7da90f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:47.303507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262a73c-bb6b-4a88-8324-c30ae7da90f6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:47.313519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 50/97] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:47 2022] GET /identity/v3/role_assignments?user.id=9d954de5ff0f4f03956c10acedd655bd&scope.project.id=b33b1839f2c34238867220c3b000af4d&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:48.834101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e6b8-d5b1-4886-929d-474ad1714b32 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:48.834609 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e6b8-d5b1-4886-929d-474ad1714b32 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:48.834716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e6b8-d5b1-4886-929d-474ad1714b32 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:48.836126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 48/98] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:48.839626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bed4d-e88c-4f19-b0ed-043be6c7f083 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:48.840006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bed4d-e88c-4f19-b0ed-043be6c7f083 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:48.840179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bed4d-e88c-4f19-b0ed-043be6c7f083 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:48.842510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 51/99] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:48.847378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3ceb-6865-4af1-a555-ec48e3f9e7d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:48.847716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3ceb-6865-4af1-a555-ec48e3f9e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:48.847991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3ceb-6865-4af1-a555-ec48e3f9e7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:48.860567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afaebb-3652-4c0c-a452-eb13bf9db94e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:48.860886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afaebb-3652-4c0c-a452-eb13bf9db94e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:48.861148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afaebb-3652-4c0c-a452-eb13bf9db94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:48.873879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7f1f3ceb-6865-4af1-a555-ec48e3f9e7d8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:48.875123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7f1f3ceb-6865-4af1-a555-ec48e3f9e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:48.894492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-33afaebb-3652-4c0c-a452-eb13bf9db94e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:48.896105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-33afaebb-3652-4c0c-a452-eb13bf9db94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:48.976095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 49/100] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:49.035322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 52/101] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:48:49.380986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f3ceb-6865-4af1-a555-ec48e3f9e7d8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:49.457860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afaebb-3652-4c0c-a452-eb13bf9db94e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:49.467245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:49.508630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f3ceb-6865-4af1-a555-ec48e3f9e7d8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:49.520837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:49.549438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a955e69-f801-4633-bc92-551eaf7b6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:49.550142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a955e69-f801-4633-bc92-551eaf7b6782 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:49.550420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a955e69-f801-4633-bc92-551eaf7b6782 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:49.550693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a955e69-f801-4633-bc92-551eaf7b6782 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:49.563381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a955e69-f801-4633-bc92-551eaf7b6782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4a955e69-f801-4633-bc92-551eaf7b6782 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:49.568822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:49.571264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 50/102] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:49.573218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a0841-5142-4c9c-bb15-715db4b9c991 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:49.574951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a0841-5142-4c9c-bb15-715db4b9c991 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:49.574951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a0841-5142-4c9c-bb15-715db4b9c991 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:49.574951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 51/103] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:49.583036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cced8c-964c-422c-836a-4bded8ab4c92 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:49.583299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cced8c-964c-422c-836a-4bded8ab4c92 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:49.583570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cced8c-964c-422c-836a-4bded8ab4c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:49.622623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b5cced8c-964c-422c-836a-4bded8ab4c92 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:49.623863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b5cced8c-964c-422c-836a-4bded8ab4c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:49.699754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afaebb-3652-4c0c-a452-eb13bf9db94e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:49.761586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 52/104] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:49.762549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cced8c-964c-422c-836a-4bded8ab4c92 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:49.771930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:49.772586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:49.772908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:49.773181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:49.777491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:49.779739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:49.781704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 53/105] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:49.787301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:49.870731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:49.923621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cced8c-964c-422c-836a-4bded8ab4c92 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:49.946133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:49.954644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb03b1-2c57-4e00-bda3-aab1c05653de None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:49.963671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce290f-1638-4e5a-8e96-5c99494003f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:49.964527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce290f-1638-4e5a-8e96-5c99494003f2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:49.964979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce290f-1638-4e5a-8e96-5c99494003f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:49.965386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce290f-1638-4e5a-8e96-5c99494003f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:49.966539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce290f-1638-4e5a-8e96-5c99494003f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:49.966858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce290f-1638-4e5a-8e96-5c99494003f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:49.968259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce290f-1638-4e5a-8e96-5c99494003f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:49.978762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 53/106] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:49.980203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20dd8a-85ba-472d-a2bd-b9eadd8f27b6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:49.980488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20dd8a-85ba-472d-a2bd-b9eadd8f27b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:49.980756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20dd8a-85ba-472d-a2bd-b9eadd8f27b6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:49.982202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 54/107] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:49.983546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4c7d-0053-4bfd-bb28-bb91262495b2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:49.983829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4c7d-0053-4bfd-bb28-bb91262495b2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:49.984100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4c7d-0053-4bfd-bb28-bb91262495b2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:49.985525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 55/108] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:49.989640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b4c7d-0053-4bfd-bb28-bb91262495b2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.005195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de617c6-fcfb-42d3-8258-77620d9cfe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:50.006365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de617c6-fcfb-42d3-8258-77620d9cfe04 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.006844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de617c6-fcfb-42d3-8258-77620d9cfe04 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.007584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de617c6-fcfb-42d3-8258-77620d9cfe04 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.009003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de617c6-fcfb-42d3-8258-77620d9cfe04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:50.011279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de617c6-fcfb-42d3-8258-77620d9cfe04 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:50.050313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 54/109] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:48:49 2022] POST /identity/v3/projects => generated 302 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:48:50.052174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc831-290a-4a1c-86a5-0e41c6e63dd2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.053331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc831-290a-4a1c-86a5-0e41c6e63dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.053863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc831-290a-4a1c-86a5-0e41c6e63dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.080067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0e1bc831-290a-4a1c-86a5-0e41c6e63dd2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:50.082296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0e1bc831-290a-4a1c-86a5-0e41c6e63dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:50.123794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b4c7d-0053-4bfd-bb28-bb91262495b2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:50.146801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:50.168206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 55/110] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:50.170413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac367f5-41d9-41d2-a198-813e1d09a110 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.171000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac367f5-41d9-41d2-a198-813e1d09a110 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.171519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac367f5-41d9-41d2-a198-813e1d09a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.172582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c2914-be54-4c43-bf95-207999fd722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:50.173316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c2914-be54-4c43-bf95-207999fd722c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.173772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c2914-be54-4c43-bf95-207999fd722c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.174051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c2914-be54-4c43-bf95-207999fd722c None admin] PATH_INFO: `/v3/users/9a7b3fa32efe4af5a801eccbe8d375c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.192704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c2914-be54-4c43-bf95-207999fd722c None admin] RBAC: Authorizing `identity:get_user(user_id=9a7b3fa32efe4af5a801eccbe8d375c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:50.193857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1ac367f5-41d9-41d2-a198-813e1d09a110 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:50.194315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c2914-be54-4c43-bf95-207999fd722c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:50.195766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1ac367f5-41d9-41d2-a198-813e1d09a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:50.196833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 56/111] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:49 2022] GET /identity/v3/users/9a7b3fa32efe4af5a801eccbe8d375c4 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:50.198316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675433d1-1006-461b-8ddd-dd5550ce0a78 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.199371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675433d1-1006-461b-8ddd-dd5550ce0a78 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.199654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675433d1-1006-461b-8ddd-dd5550ce0a78 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.201539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 57/112] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:50.202489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675433d1-1006-461b-8ddd-dd5550ce0a78 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.284492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 56/113] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:50.291623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac367f5-41d9-41d2-a198-813e1d09a110 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.301474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:50.334908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675433d1-1006-461b-8ddd-dd5550ce0a78 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:50.375100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97877c-3f61-4e8d-9673-8a7eadaad2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:50.375736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97877c-3f61-4e8d-9673-8a7eadaad2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.376015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97877c-3f61-4e8d-9673-8a7eadaad2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.376285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97877c-3f61-4e8d-9673-8a7eadaad2f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.386992 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97877c-3f61-4e8d-9673-8a7eadaad2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fc97877c-3f61-4e8d-9673-8a7eadaad2f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:50.392843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:50.393694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:50.394426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 58/114] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:50.395567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ff7b-adab-4798-9b82-4d5beadaf90d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.395567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ff7b-adab-4798-9b82-4d5beadaf90d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.395724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ff7b-adab-4798-9b82-4d5beadaf90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.416111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c385ff7b-adab-4798-9b82-4d5beadaf90d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:50.417628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c385ff7b-adab-4798-9b82-4d5beadaf90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:50.418615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac367f5-41d9-41d2-a198-813e1d09a110 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:50.458357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442742-d753-4938-b698-57502193adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:50.459032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442742-d753-4938-b698-57502193adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.459317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442742-d753-4938-b698-57502193adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.459783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442742-d753-4938-b698-57502193adb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.460064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:50.494890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 59/115] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:50.495925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ff7b-adab-4798-9b82-4d5beadaf90d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.539327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b442742-d753-4938-b698-57502193adb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:50.540723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b442742-d753-4938-b698-57502193adb4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:50.561722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:50.599885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ff7b-adab-4798-9b82-4d5beadaf90d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:50.663153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:50.664110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.664586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.665353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.666812 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:50.667339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:50.669784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:50.681606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 60/116] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:50.683554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.708949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 57/117] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:50.708949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442742-d753-4938-b698-57502193adb4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.737171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:50.820663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01806056-129b-4eba-8687-b69cad0aff67 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:50.834354 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442742-d753-4938-b698-57502193adb4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:50.842460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:50.859200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:50.859932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.860366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.860468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.870983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:50.871355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:50.871783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:50.871950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:50.872182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:50.876826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:50.877675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:50.878405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 61/118] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:48:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:50.879772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.889175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:50.894128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:50.894998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:50.895805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 58/119] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:50.896458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:50.982680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.002375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73273488-55bc-4831-9e75-0cef0517ac5b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.003372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd6ac-a28b-4eb5-a30a-6c956d314bc6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.039417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233719ba-5374-485b-982a-53060e6950ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.040244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.040387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233719ba-5374-485b-982a-53060e6950ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.040387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233719ba-5374-485b-982a-53060e6950ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.040666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233719ba-5374-485b-982a-53060e6950ff None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.040934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.041208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.041479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.041844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233719ba-5374-485b-982a-53060e6950ff None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.042711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.043290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233719ba-5374-485b-982a-53060e6950ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.044155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.050141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 62/120] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:50 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.050141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233719ba-5374-485b-982a-53060e6950ff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.050359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 59/121] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:50 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.050359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.084161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.154909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256caf9-da63-407c-8161-1dd5aee50fa8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.157292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233719ba-5374-485b-982a-53060e6950ff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.192997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.193759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.194088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.194305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.195037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:51.195388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.195677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.195965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.196246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.196517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.197082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.206469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 60/122] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.207705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:51.211597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:51.212577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:51.213500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 63/123] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:51.214599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.233396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.319722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.327819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074ba4-46f6-46fa-8890-dda7a3abe2d5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.327967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09eacb-4eb6-4b6f-b92f-b152d09945f8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.371247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.371803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.372106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.372418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.373160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:51.373469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.373922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.374764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.374926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.375404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.375859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.377269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.378912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.380829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 64/124] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.381674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.390383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 61/125] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.394147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.476944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.496824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951041a-bbb2-45cc-9272-c85ca2492c7f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.513698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b9a2-ab33-420c-889a-d738db232bb6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.533012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.533619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.533893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.534160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.535307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] RBAC: Adding query filter params (role.id=9b29ff5da37348b084fb11e2a3e687eb, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=9a7b3fa32efe4af5a801eccbe8d375c4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:51.535872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.537807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.556844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 65/126] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/role_assignments?user.id=9a7b3fa32efe4af5a801eccbe8d375c4&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=9b29ff5da37348b084fb11e2a3e687eb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.556844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.558834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.559691 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.560121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.560431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.561659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.563144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.569321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 62/127] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.569321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.601554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.685325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7a0b-e920-43e9-a217-bdbf11720abe None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.690326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac802e84-7753-4fc8-9149-7241cc86dd99 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.726663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.727699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.728149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.728591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790/users/9d954de5ff0f4f03956c10acedd655bd/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.730837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=febd778fccb344b5a7b41cd249190790, user_id=9d954de5ff0f4f03956c10acedd655bd, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.732711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.741338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.742062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.742419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.742758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.743856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:51.744221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.750100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:51.755326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 63/128] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:48:51 2022] PUT /identity/v3/projects/febd778fccb344b5a7b41cd249190790/users/9d954de5ff0f4f03956c10acedd655bd/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:51.756421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.761802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 66/129] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:51.761802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:51.777764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.937738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:51.954408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a5b0-1ea9-4ec8-8ccf-4e0c36849ac7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.959002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37884-2810-4db9-aa04-b5b19dfc12b9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:51.992609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:51.993631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:51.993919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:51.994198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] PATH_INFO: `/v3/users/ed9887c2ab9944d2a1b8d085a3861143` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:51.996199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] RBAC: Authorizing `identity:get_user(user_id=ed9887c2ab9944d2a1b8d085a3861143)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:51.998682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.000536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 64/130] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/users/ed9887c2ab9944d2a1b8d085a3861143 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:52.005693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:52.007026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:52.007872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.008562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.009048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.011705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:52.013520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.015538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 67/131] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:51 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:52.016139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:52.133927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8341d1-6e0e-4618-bdbc-9dc6268c9547 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:52.138357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:52.172662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:52.173697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.174190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.174651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.176104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:52.177843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.180055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 65/132] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:52 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:52.181027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:52.181334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d872c3-13af-423b-a001-452093c48bb2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:52.227293 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:52.227852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.228135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.228409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.229208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:52.229555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:52.231795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.235103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 68/133] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:52 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:52.235755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:52.313324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde266f-11d2-4715-b17d-098bb621f7dd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:52.342205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd06594-b6f0-4026-8f9e-0affae1295e8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:52.349421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:52.350218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.350507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.350781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790/users/9d954de5ff0f4f03956c10acedd655bd/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.353147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] RBAC: Authorizing `identity:create_grant(project_id=febd778fccb344b5a7b41cd249190790, user_id=9d954de5ff0f4f03956c10acedd655bd, role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:52.354729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.374221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 66/134] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:48:52 2022] PUT /identity/v3/projects/febd778fccb344b5a7b41cd249190790/users/9d954de5ff0f4f03956c10acedd655bd/roles/407978df648d44abb9a8aafed3b0793f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:52.375110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:52.398208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ea327-7b72-492f-af94-4700c0dcf1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:52.398881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ea327-7b72-492f-af94-4700c0dcf1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.399163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ea327-7b72-492f-af94-4700c0dcf1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.399442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ea327-7b72-492f-af94-4700c0dcf1c0 None admin] PATH_INFO: `/v3/projects/b33b1839f2c34238867220c3b000af4d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.405742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ea327-7b72-492f-af94-4700c0dcf1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b33b1839f2c34238867220c3b000af4d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:52.407274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ea327-7b72-492f-af94-4700c0dcf1c0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.409375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 69/135] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:52 2022] GET /identity/v3/projects/b33b1839f2c34238867220c3b000af4d => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:52.410616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca256-7263-493d-af5f-e2185c3c0c0b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.410833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca256-7263-493d-af5f-e2185c3c0c0b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.411103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca256-7263-493d-af5f-e2185c3c0c0b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.412295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 70/136] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:52.417681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b0ec-b0d1-4da6-8c32-efb0158f73c5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.417983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b0ec-b0d1-4da6-8c32-efb0158f73c5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.418225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b0ec-b0d1-4da6-8c32-efb0158f73c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.465159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a519b0ec-b0d1-4da6-8c32-efb0158f73c5 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:52.466498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a519b0ec-b0d1-4da6-8c32-efb0158f73c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:52.482233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:52.485198 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:52.520342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3019-eff6-446b-a5f2-151ecd79eb45 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:52.594089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:52.594858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.595134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.595407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790/users/ed9887c2ab9944d2a1b8d085a3861143/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.596370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 71/137] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:52.597577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] RBAC: Authorizing `identity:create_grant(project_id=febd778fccb344b5a7b41cd249190790, user_id=ed9887c2ab9944d2a1b8d085a3861143, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:52.599040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.601454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b0ec-b0d1-4da6-8c32-efb0158f73c5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:52.615974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 67/138] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:48:52 2022] PUT /identity/v3/projects/febd778fccb344b5a7b41cd249190790/users/ed9887c2ab9944d2a1b8d085a3861143/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:52.747257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b0ec-b0d1-4da6-8c32-efb0158f73c5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:52.802083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:52.802779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:52.803061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:52.803355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] PATH_INFO: `/v3/projects/b33b1839f2c34238867220c3b000af4d/users/9d954de5ff0f4f03956c10acedd655bd/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:52.805421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] RBAC: Authorizing `identity:create_grant(project_id=b33b1839f2c34238867220c3b000af4d, user_id=9d954de5ff0f4f03956c10acedd655bd, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:52.806920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:52.832084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 72/139] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:48:52 2022] PUT /identity/v3/projects/b33b1839f2c34238867220c3b000af4d/users/9d954de5ff0f4f03956c10acedd655bd/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:53.158514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:53.275366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb192-e2e1-43cd-95da-8f9bee2e2949 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:53.312504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84028df5-15f8-49c4-92f0-5b0389b0e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:53.313182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028df5-15f8-49c4-92f0-5b0389b0e9ca None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:53.313456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028df5-15f8-49c4-92f0-5b0389b0e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:53.313730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028df5-15f8-49c4-92f0-5b0389b0e9ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:53.314858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84028df5-15f8-49c4-92f0-5b0389b0e9ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:53.316324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84028df5-15f8-49c4-92f0-5b0389b0e9ca None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:53.318280 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 68/140] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:53.323540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:53.326677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:53.435322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac960a-b88a-4de0-9952-b9f0b26ed358 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:53.470258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aeb81-e8f9-4c99-b941-f0543951cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:53.470878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aeb81-e8f9-4c99-b941-f0543951cb13 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:53.471466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aeb81-e8f9-4c99-b941-f0543951cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:53.471745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aeb81-e8f9-4c99-b941-f0543951cb13 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:53.472463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aeb81-e8f9-4c99-b941-f0543951cb13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:53.473954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aeb81-e8f9-4c99-b941-f0543951cb13 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:53.503313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 73/141] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:48:53 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:48:53.880583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53350-1363-4e01-b84e-be409e3a07c0 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:53.880897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53350-1363-4e01-b84e-be409e3a07c0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:53.881167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53350-1363-4e01-b84e-be409e3a07c0 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:53.882708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 69/142] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:53.888406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb819-ee76-451b-beeb-c34bb3a012b8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:53.888682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb819-ee76-451b-beeb-c34bb3a012b8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:53.889119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb819-ee76-451b-beeb-c34bb3a012b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:53.912652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-96aeb819-ee76-451b-beeb-c34bb3a012b8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:53.913870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-96aeb819-ee76-451b-beeb-c34bb3a012b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:53.976187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:53.996475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 74/143] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:54.176321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f395-8359-4204-b274-0754318c52d8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:54.176870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f395-8359-4204-b274-0754318c52d8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:54.176870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f395-8359-4204-b274-0754318c52d8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:54.178547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 70/144] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:54.183546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4d47-47a6-48d3-9597-ed941a6d6360 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:54.183838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4d47-47a6-48d3-9597-ed941a6d6360 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:54.184104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a4d47-47a6-48d3-9597-ed941a6d6360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:54.208926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-344a4d47-47a6-48d3-9597-ed941a6d6360 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:54.210252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-344a4d47-47a6-48d3-9597-ed941a6d6360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:54.288540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 75/145] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:54.404549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0f395-8359-4204-b274-0754318c52d8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:54.417946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:54.541476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0f395-8359-4204-b274-0754318c52d8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:54.585389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:54.586040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:54.586375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:54.586659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:54.600277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:54.608914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:54.609814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:54.610579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 71/146] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:54.617296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a4d47-47a6-48d3-9597-ed941a6d6360 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:54.655670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:54.801234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:54.803183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a4d47-47a6-48d3-9597-ed941a6d6360 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:54.827078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:54.850812 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:54.851446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:54.851732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:54.852005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:54.852775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:54.853471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:54.855574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:54.864886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9596b-cfa6-42e8-9169-299cb261ade8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:54.865980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 76/147] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:54.873254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:54.936517 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:54.937206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:54.937547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:54.937764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:54.960861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:54.966150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:54.967075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:54.967823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:54.969800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 72/148] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:48:54.975728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:54.987758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0dbb-545d-4ae2-aed3-b0f92ce5f26d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:55.027579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:55.028287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.028597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.028894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] PATH_INFO: `/v3/users/9a7b3fa32efe4af5a801eccbe8d375c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.030178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] RBAC: Authorizing `identity:get_user(user_id=9a7b3fa32efe4af5a801eccbe8d375c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:55.031650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:55.033441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 77/149] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:54 2022] GET /identity/v3/users/9a7b3fa32efe4af5a801eccbe8d375c4 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:55.039955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:55.101893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:55.169755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f5050-fa60-4b5c-a415-bcae21498428 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:55.180770 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3897-5fc3-4469-81b7-2d52562c290d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:55.211259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:55.211897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.212223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.212497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.213687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:55.215188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:55.218024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 78/150] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:55 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:55.224280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:55.238177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:55.250071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:55.250702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.250986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.251258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.251938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:55.252237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:55.253832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:55.272439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 73/151] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:55.278476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:55.344862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf873-72c3-4b5b-9a10-36d16650ccf2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:55.364911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:55.385488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:55.386161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.386477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.386744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790/users/9a7b3fa32efe4af5a801eccbe8d375c4/roles/9b29ff5da37348b084fb11e2a3e687eb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.389413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=febd778fccb344b5a7b41cd249190790, user_id=9a7b3fa32efe4af5a801eccbe8d375c4, role_id=9b29ff5da37348b084fb11e2a3e687eb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:55.390876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:55.409052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 79/152] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:48:55 2022] PUT /identity/v3/projects/febd778fccb344b5a7b41cd249190790/users/9a7b3fa32efe4af5a801eccbe8d375c4/roles/9b29ff5da37348b084fb11e2a3e687eb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:55.510336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420cb8-983e-449e-b39c-477c8575a0ca None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:55.559341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a4c2-a98d-4287-8576-7fe6eaf47d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:55.560155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a4c2-a98d-4287-8576-7fe6eaf47d3a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.560441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a4c2-a98d-4287-8576-7fe6eaf47d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.560711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a4c2-a98d-4287-8576-7fe6eaf47d3a None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.565725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a4c2-a98d-4287-8576-7fe6eaf47d3a None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:55.567246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a4c2-a98d-4287-8576-7fe6eaf47d3a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:55.569455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 74/153] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:55 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:55.575417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:55.715230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176205ea-af83-47e2-92fa-d19737a982d7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.715609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176205ea-af83-47e2-92fa-d19737a982d7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.715609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176205ea-af83-47e2-92fa-d19737a982d7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.717499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 75/154] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:55.723120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31da36-107d-40b1-831c-a49938fe87e4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:55.723739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a02b-40ed-4a7e-b7a5-91e1c12f63dc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.723739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a02b-40ed-4a7e-b7a5-91e1c12f63dc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.724034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a02b-40ed-4a7e-b7a5-91e1c12f63dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.760695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:55.761339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:55.761614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:55.761925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:55.777875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3b08a02b-40ed-4a7e-b7a5-91e1c12f63dc None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:55.779156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3b08a02b-40ed-4a7e-b7a5-91e1c12f63dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:55.815195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:55.839606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:55.841335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:55.914518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:55.950561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 80/156] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:55.950758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 76/156] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:55.956728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:56.061231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:56.084467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04530-611b-4284-99d9-5961077ed61b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:56.128395 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a29eec-2d25-4a6b-91ca-f4bc5202d583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:56.129072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29eec-2d25-4a6b-91ca-f4bc5202d583 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:56.129390 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29eec-2d25-4a6b-91ca-f4bc5202d583 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:56.129751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29eec-2d25-4a6b-91ca-f4bc5202d583 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:56.130874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a29eec-2d25-4a6b-91ca-f4bc5202d583 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:56.132416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a29eec-2d25-4a6b-91ca-f4bc5202d583 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:56.134286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 81/157] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:55 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:56.141975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a02b-40ed-4a7e-b7a5-91e1c12f63dc None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:56.223210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5b02-6fbd-44e4-8deb-427ba9353b4d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:56.223568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5b02-6fbd-44e4-8deb-427ba9353b4d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:56.223742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5b02-6fbd-44e4-8deb-427ba9353b4d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:56.225951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 82/158] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:48:56.234681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab16b-6051-4aad-b51b-646f00e61866 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:56.234967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab16b-6051-4aad-b51b-646f00e61866 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:56.235379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab16b-6051-4aad-b51b-646f00e61866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:56.264215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3e2ab16b-6051-4aad-b51b-646f00e61866 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:56.265437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e2ab16b-6051-4aad-b51b-646f00e61866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:56.300909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a02b-40ed-4a7e-b7a5-91e1c12f63dc None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:56.375073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:56.375612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:56.375893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:56.376164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:56.376926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=9d954de5ff0f4f03956c10acedd655bd) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:56.377237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:56.378679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:56.392571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 77/159] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:56 2022] GET /identity/v3/role_assignments?user.id=9d954de5ff0f4f03956c10acedd655bd&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:56.412882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 83/160] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:56.606430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:56.684122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:56.739061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec752-af3f-4f7d-aa9c-6ad8255d6752 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:56.741036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141300f5-2f32-495d-a115-70f43054cffe None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:56.741492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141300f5-2f32-495d-a115-70f43054cffe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:56.741573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141300f5-2f32-495d-a115-70f43054cffe None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:56.742912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 84/161] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:48:56.753996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfea93-be5f-498a-b086-b1648ba5318f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:56.754273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfea93-be5f-498a-b086-b1648ba5318f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:56.754536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfea93-be5f-498a-b086-b1648ba5318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:56.793401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-42cfea93-be5f-498a-b086-b1648ba5318f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:56.794691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-42cfea93-be5f-498a-b086-b1648ba5318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:56.843569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:56.844211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:56.844488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:56.844756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:56.869560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:56.875228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:56.876082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:56.876833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 78/162] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:48:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:56.883503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:56.920306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 85/163] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:57.052111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfea93-be5f-498a-b086-b1648ba5318f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:57.059563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:57.132763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac4b0-3119-4e14-8083-7753a7e3fe36 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:57.156361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:57.184751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfea93-be5f-498a-b086-b1648ba5318f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:57.205555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:57.206196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:57.206475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:57.206746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:57.207427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:57.207725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:57.209153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:57.235178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:57.235859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:57.236141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:57.236407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:57.237387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 79/164] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:48:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:57.244412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:57.260468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:57.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:57.273839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:48:57.274577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:57.276839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 86/165] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:57.282175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:57.424909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:57.449528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd159-87a8-443a-b35d-b33fa06823d9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:57.495414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266d7a-5670-47bb-8e07-e4751af23b2a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:57.526117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:57.527125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:57.527587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:57.528054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:57.529702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:57.531384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:57.534533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 80/166] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:57 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:57.539568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:57.587891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:57.588884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:57.589402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:57.589903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:57.591497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:57.592002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:57.593617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:57.613762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 87/167] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:57.620036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:57.642313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:57.727934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb263dc-66dc-44a0-8344-ede402fba48f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:57.777690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150972a6-0177-43f5-a14a-362298ae0095 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:57.786736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:57.787282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:57.787569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:57.787848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:57.838420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:57.851874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:57.852520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:57.852814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:57.853085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] PATH_INFO: `/v3/users/9d954de5ff0f4f03956c10acedd655bd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:57.858447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] RBAC: Authorizing `identity:get_user(user_id=9d954de5ff0f4f03956c10acedd655bd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:57.859940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:57.869108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 88/168] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:57 2022] GET /identity/v3/users/9d954de5ff0f4f03956c10acedd655bd => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:48:57.870036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:57.937457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:57.938947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:58.042455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:58.106984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30faa1-3033-4786-be5d-66d0dbe6380e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:58.153825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:58.154497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.154777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.155047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.166599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:58.173396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:58.174304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:58.175098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 89/169] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:58.175734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:58.199436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 81/170] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:58.200346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:58.244327 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:58.324585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd765-bfb6-4f26-8935-d443085dc76a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:58.345297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0416d0-c566-47d7-b8f7-66d0408107c9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:58.386712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:58.387981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.387981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.388556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.389500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:58.389932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:58.391551 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:58.394915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0f03-a5af-4395-a187-177a360b8434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:58.395785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0f03-a5af-4395-a187-177a360b8434 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.396238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0f03-a5af-4395-a187-177a360b8434 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.396645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0f03-a5af-4395-a187-177a360b8434 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.401982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 82/171] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:58.402943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:58.413682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:58.521223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3930c57-7efc-4c46-9ddc-306c2976046d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:58.532151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0f03-a5af-4395-a187-177a360b8434 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:58.534011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0f03-a5af-4395-a187-177a360b8434 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:58.563625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67230a9b-d781-42a4-8197-0bba2d72e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:58.564584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67230a9b-d781-42a4-8197-0bba2d72e11a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.564893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67230a9b-d781-42a4-8197-0bba2d72e11a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.565304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67230a9b-d781-42a4-8197-0bba2d72e11a None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.566579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67230a9b-d781-42a4-8197-0bba2d72e11a None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:58.569042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67230a9b-d781-42a4-8197-0bba2d72e11a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:58.570779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 83/172] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:58 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:58.577533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414dd1-57ce-42a0-a0f9-e03833ba9239 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.577746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414dd1-57ce-42a0-a0f9-e03833ba9239 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.578024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414dd1-57ce-42a0-a0f9-e03833ba9239 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.580174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 84/173] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:58.581643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414dd1-57ce-42a0-a0f9-e03833ba9239 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:58.597179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:58.650943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 90/174] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:58.650943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f193f-b81d-4faa-8952-2ac4adacc7da None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.650943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f193f-b81d-4faa-8952-2ac4adacc7da None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.650943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f193f-b81d-4faa-8952-2ac4adacc7da None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.650943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 91/175] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:58.650943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f193f-b81d-4faa-8952-2ac4adacc7da None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:58.674651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:58.703444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414dd1-57ce-42a0-a0f9-e03833ba9239 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:58.752149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411993f-332a-40b1-8c73-62f7475da61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:58.753166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411993f-332a-40b1-8c73-62f7475da61d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.753166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411993f-332a-40b1-8c73-62f7475da61d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.753436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411993f-332a-40b1-8c73-62f7475da61d None admin] PATH_INFO: `/v3/users/ed9887c2ab9944d2a1b8d085a3861143` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.754594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411993f-332a-40b1-8c73-62f7475da61d None admin] RBAC: Authorizing `identity:get_user(user_id=ed9887c2ab9944d2a1b8d085a3861143)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:58.756098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411993f-332a-40b1-8c73-62f7475da61d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:58.757888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 85/176] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:48:58 2022] GET /identity/v3/users/ed9887c2ab9944d2a1b8d085a3861143 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:58.759107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867fb2-6dde-40fd-877f-36543848df1c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.759388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867fb2-6dde-40fd-877f-36543848df1c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.759728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867fb2-6dde-40fd-877f-36543848df1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.776367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f193f-b81d-4faa-8952-2ac4adacc7da None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:58.777962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a3867fb2-6dde-40fd-877f-36543848df1c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:58.779477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a3867fb2-6dde-40fd-877f-36543848df1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:58.812207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e267d32-4f93-4c32-813a-03b04ec0e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:58.812810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267d32-4f93-4c32-813a-03b04ec0e689 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.813126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267d32-4f93-4c32-813a-03b04ec0e689 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.813382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267d32-4f93-4c32-813a-03b04ec0e689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.814135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e267d32-4f93-4c32-813a-03b04ec0e689 None admin] RBAC: Adding query filter params (role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=9d954de5ff0f4f03956c10acedd655bd) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:58.814497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e267d32-4f93-4c32-813a-03b04ec0e689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:58.815901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e267d32-4f93-4c32-813a-03b04ec0e689 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:58.822273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 92/177] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:58 2022] GET /identity/v3/role_assignments?user.id=9d954de5ff0f4f03956c10acedd655bd&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=407978df648d44abb9a8aafed3b0793f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:58.824263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64194-9e91-4992-ba5b-0f6ef3af4e5b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.824770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64194-9e91-4992-ba5b-0f6ef3af4e5b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.825322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64194-9e91-4992-ba5b-0f6ef3af4e5b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.832103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 93/178] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:58.832103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c64194-9e91-4992-ba5b-0f6ef3af4e5b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:58.863865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 86/179] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:58.869098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8246-0ee3-4852-9a91-a0251c5d1e57 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:58.869098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8246-0ee3-4852-9a91-a0251c5d1e57 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:58.869098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8246-0ee3-4852-9a91-a0251c5d1e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:58.885300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:58.896671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c40c8246-0ee3-4852-9a91-a0251c5d1e57 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:58.898004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c40c8246-0ee3-4852-9a91-a0251c5d1e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:58.996592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 87/180] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:58.997466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8246-0ee3-4852-9a91-a0251c5d1e57 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:58.999879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.008783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c64194-9e91-4992-ba5b-0f6ef3af4e5b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.047047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c211be-12e6-4d6e-b8fa-6130998c3202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.047687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c211be-12e6-4d6e-b8fa-6130998c3202 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.047963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c211be-12e6-4d6e-b8fa-6130998c3202 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.048233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c211be-12e6-4d6e-b8fa-6130998c3202 None admin] PATH_INFO: `/v3/projects/b33b1839f2c34238867220c3b000af4d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.049504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c211be-12e6-4d6e-b8fa-6130998c3202 None admin] RBAC: Authorizing `identity:get_project(project_id=b33b1839f2c34238867220c3b000af4d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:59.051080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c211be-12e6-4d6e-b8fa-6130998c3202 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:59.056919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 94/181] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:58 2022] GET /identity/v3/projects/b33b1839f2c34238867220c3b000af4d => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:59.058236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65007aa8-b2ee-4a35-82b2-10e6dc2d451c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.058617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65007aa8-b2ee-4a35-82b2-10e6dc2d451c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.058897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65007aa8-b2ee-4a35-82b2-10e6dc2d451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.080058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-65007aa8-b2ee-4a35-82b2-10e6dc2d451c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:59.081296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-65007aa8-b2ee-4a35-82b2-10e6dc2d451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:59.101983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8246-0ee3-4852-9a91-a0251c5d1e57 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.139375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe6bcc-8f39-49c2-ad5c-07943ab3c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.140000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe6bcc-8f39-49c2-ad5c-07943ab3c82c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.140279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe6bcc-8f39-49c2-ad5c-07943ab3c82c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.140594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe6bcc-8f39-49c2-ad5c-07943ab3c82c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.158060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 95/182] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:59.160236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143debb9-8bb1-4eec-a12c-640ca9f18b93 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.160762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143debb9-8bb1-4eec-a12c-640ca9f18b93 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.161211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143debb9-8bb1-4eec-a12c-640ca9f18b93 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.162978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 96/183] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:48:59.163917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143debb9-8bb1-4eec-a12c-640ca9f18b93 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.183974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.219787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe6bcc-8f39-49c2-ad5c-07943ab3c82c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:59.221342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe6bcc-8f39-49c2-ad5c-07943ab3c82c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:59.223378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.310182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143debb9-8bb1-4eec-a12c-640ca9f18b93 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.341289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 88/184] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:59.343161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107019e-066b-4f1a-b022-39e4176e840a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.343449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107019e-066b-4f1a-b022-39e4176e840a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.343875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107019e-066b-4f1a-b022-39e4176e840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.349268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.349867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.350136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.350406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.351155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=b33b1839f2c34238867220c3b000af4d, user.id=9d954de5ff0f4f03956c10acedd655bd) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:59.351447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:59.352996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:59.358761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 97/185] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/role_assignments?user.id=9d954de5ff0f4f03956c10acedd655bd&scope.project.id=b33b1839f2c34238867220c3b000af4d&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:59.359561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.363118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6107019e-066b-4f1a-b022-39e4176e840a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:48:59.364336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6107019e-066b-4f1a-b022-39e4176e840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:59.451567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 89/186] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:48:59.453856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107019e-066b-4f1a-b022-39e4176e840a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.467129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.494088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.496189 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e678-f3ce-4a8a-b144-d8e3376e11e5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.539454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.540124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.540405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.540676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.552570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:59.558108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:59.558948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:48:59.559832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:48:59.562158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 98/187] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:59.563186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.577814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107019e-066b-4f1a-b022-39e4176e840a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.627170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.628173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.628669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.629183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.641657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:59.646722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:59.647706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:59.648712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 90/188] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:59.649652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.685234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de804c-b899-4c79-9b91-59d96a2337de None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.720387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.721102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.721383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.721658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.722808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:59.724300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:59.730944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 99/189] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:59.730944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.742566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.760994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.771325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5667d1-35da-4e49-8219-8b899b48c0d5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.806666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.807304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.807577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.807824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.819300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:48:59.824086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:48:59.825197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:48:59.826162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 91/190] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:48:59.826815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.839295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e6f8a-ddbb-4fae-94db-594d28d94d91 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.874510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.875135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.875404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.875669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.876323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:59.876615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:59.878077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:59.885998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 100/191] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:59.886768 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.929923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68749-19d8-4294-9874-064818b5bd78 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:59.960472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.963914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:59.964566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:59.964863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:59.965135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:59.965866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:48:59.966210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:59.967590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:59.975868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 92/192] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:48:59.976680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:59.992335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:59.994881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a52e-cd64-49a3-88f2-c0c0dc3a1122 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.028639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.029255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.029528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.029795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.030519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=ed9887c2ab9944d2a1b8d085a3861143) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:00.030816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.032269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.038192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 101/193] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/role_assignments?user.id=ed9887c2ab9944d2a1b8d085a3861143&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:00.038955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.082170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1152323-2c28-402a-a32e-b832c7e7b977 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.121942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.122601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.122880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.123175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.124438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.125968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.127957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 93/194] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:48:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:00.128546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.165817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39240d-5dbd-4aa7-8184-c1668622b7b1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.207997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.208642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.208962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.209229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.209904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:00.210201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.211606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.213105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:00.221896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 102/195] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:00.225844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.233688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:00.257491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756400da-c41b-45f0-9e32-4b10720c0fd3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.292651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.293315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.293589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.293878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] PATH_INFO: `/v3/users/58b4fd8cdcd642769441090a346787ec` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.307710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] RBAC: Authorizing `identity:get_user(user_id=58b4fd8cdcd642769441090a346787ec)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.309195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.311080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 94/196] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/users/58b4fd8cdcd642769441090a346787ec => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:00.311807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.334157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47843af-fcdf-4427-8cb7-8c4b8551aa40 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.368646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.369312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.369584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.369841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] PATH_INFO: `/v3/users/9a7b3fa32efe4af5a801eccbe8d375c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.370982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] RBAC: Authorizing `identity:get_user(user_id=9a7b3fa32efe4af5a801eccbe8d375c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.372503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.374317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 103/197] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/users/9a7b3fa32efe4af5a801eccbe8d375c4 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:00.379392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.421331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4ddde-1215-44b9-b5de-d08a9a3a10a6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.441333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:00.455837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.456577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.457130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.457643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.458819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.460776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.472595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:00.480652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee5841-1c79-48ca-bea5-e87712e096f8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.484525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 95/198] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:00 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:00.485356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.532080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.532742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.533045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.533314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] PATH_INFO: `/v3/users/58b4fd8cdcd642769441090a346787ec` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.534546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] RBAC: Authorizing `identity:get_user(user_id=58b4fd8cdcd642769441090a346787ec)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.536720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.540861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 104/199] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/users/58b4fd8cdcd642769441090a346787ec => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:00.542176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.612593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008149fa-3a63-4a7e-8af1-980ff7f4f92e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.655771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.656651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.657034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.657307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.669246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26b2fb-ba69-4f89-b578-cbef7f087aec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:00.704191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:00.710807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:00.711720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:00.711720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:00.711975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:00.732075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:00.739906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.741557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.802596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:00.804179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:00.874661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 96/200] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:00.875760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.924823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 105/201] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:00.925700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:00.958442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:01.003445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2183-1cfc-405b-ac6e-eab818e5d7f1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:01.017260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:01.034746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826e32-f9de-498c-a3a6-65f3d359369f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:01.047976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:01.049423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:01.049967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:01.050402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:01.075049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:01.075836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:01.076215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:01.076552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:01.077862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:01.079521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:01.086399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 106/202] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:01.087506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:01.136751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:01.139335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:01.197383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:01.202670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd85a1-0ba7-4c18-8faa-d8f3ee3f75ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:01.241057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:01.241765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:01.242032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:01.242306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:01.243944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:01.245477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:01.247612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 107/203] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:01 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:01.248846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:01.259548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:01.268901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 97/204] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:01.269857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:01.374900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea000a43-b666-4019-a002-8126571a7011 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:01.396063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9781d7-57a8-4fb1-90b1-128d1d94ff5c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:01.411083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:01.411696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:01.411973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:01.412242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:01.413075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=58b4fd8cdcd642769441090a346787ec) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:01.413382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:01.414847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:01.420792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 108/205] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:01 2022] GET /identity/v3/role_assignments?user.id=58b4fd8cdcd642769441090a346787ec&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:01.429882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:01.437620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:01.438269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:01.440834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:01.440834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:01.440834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] RBAC: Adding query filter params (role.id=9b29ff5da37348b084fb11e2a3e687eb, scope.project.id=febd778fccb344b5a7b41cd249190790, user.id=9a7b3fa32efe4af5a801eccbe8d375c4) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:01.440834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:01.442654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:01.461433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 98/206] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:01 2022] GET /identity/v3/role_assignments?user.id=9a7b3fa32efe4af5a801eccbe8d375c4&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=9b29ff5da37348b084fb11e2a3e687eb => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:01.497431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:01.609497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0c082-3d95-4b8e-99d0-dd05100724ac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:01.652520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb00a6d-c26f-4d14-86d6-701b01eded1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:01.653272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00a6d-c26f-4d14-86d6-701b01eded1d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:01.653555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00a6d-c26f-4d14-86d6-701b01eded1d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:01.653957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb00a6d-c26f-4d14-86d6-701b01eded1d None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:01.655202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb00a6d-c26f-4d14-86d6-701b01eded1d None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:01.656759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb00a6d-c26f-4d14-86d6-701b01eded1d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:01.658883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 109/207] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:01 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:01.664427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:01.734259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:01.786872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aca11b-99a7-42bb-bf90-11eeaae66a4d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:01.834078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b80a9b-e488-4d9f-96f7-cc958478d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:01.834706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80a9b-e488-4d9f-96f7-cc958478d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:01.834986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80a9b-e488-4d9f-96f7-cc958478d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:01.835255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80a9b-e488-4d9f-96f7-cc958478d7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:01.835995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b80a9b-e488-4d9f-96f7-cc958478d7c1 None admin] RBAC: Adding query filter params (role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=58b4fd8cdcd642769441090a346787ec) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:01.836300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b80a9b-e488-4d9f-96f7-cc958478d7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:01.837804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b80a9b-e488-4d9f-96f7-cc958478d7c1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:01.844063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 99/208] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:01 2022] GET /identity/v3/role_assignments?user.id=58b4fd8cdcd642769441090a346787ec&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=407978df648d44abb9a8aafed3b0793f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:02.649614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0f9d-ffc2-4c37-84aa-3c4e675e7fc3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:02.649614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0f9d-ffc2-4c37-84aa-3c4e675e7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:02.649614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0f9d-ffc2-4c37-84aa-3c4e675e7fc3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:02.649614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 110/209] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:02.660731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166ada-9779-406c-9dd1-f94c8e974d34 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:02.660731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166ada-9779-406c-9dd1-f94c8e974d34 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:02.660731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62166ada-9779-406c-9dd1-f94c8e974d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:02.678578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-62166ada-9779-406c-9dd1-f94c8e974d34 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:02.680597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-62166ada-9779-406c-9dd1-f94c8e974d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:02.725250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425cef-b5cb-41e2-bd11-9ded3eae3fa5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:02.725864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425cef-b5cb-41e2-bd11-9ded3eae3fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:02.726330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425cef-b5cb-41e2-bd11-9ded3eae3fa5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:02.727868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 111/210] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:02.734261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f037-1278-4f54-8b84-246ad6984b37 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:02.734774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f037-1278-4f54-8b84-246ad6984b37 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:02.735246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f037-1278-4f54-8b84-246ad6984b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:02.755270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-20b4f037-1278-4f54-8b84-246ad6984b37 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:02.756579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20b4f037-1278-4f54-8b84-246ad6984b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:02.758349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 100/211] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:02.825518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 112/212] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:03.028394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62166ada-9779-406c-9dd1-f94c8e974d34 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:03.083525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:03.109545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f037-1278-4f54-8b84-246ad6984b37 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:03.131997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62166ada-9779-406c-9dd1-f94c8e974d34 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:03.145396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:03.176334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:03.177068 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.177342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.177609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.190709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:03.196226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:03.197370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:03.198130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:03.205211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 101/213] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:03.205211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:03.233791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f037-1278-4f54-8b84-246ad6984b37 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:03.272169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:03.273319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.273787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.274271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.275734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:03.277439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:03.279476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 113/214] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:03.286570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:03.328938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202e987-51ce-46f6-8c78-29216816a61a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:03.350757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:03.378999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:03.379615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.379883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.380152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.380841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:03.381146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:03.382531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:03.396880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 102/215] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:03.401271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:03.414925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:03.420660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c1e2-a152-440f-88e6-57347eea5bd8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:03.458723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac6442-6ea9-419c-91ea-619d0baa6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:03.459329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6442-6ea9-419c-91ea-619d0baa6ea5 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.459832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6442-6ea9-419c-91ea-619d0baa6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.460562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6442-6ea9-419c-91ea-619d0baa6ea5 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.461431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac6442-6ea9-419c-91ea-619d0baa6ea5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:03.463883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac6442-6ea9-419c-91ea-619d0baa6ea5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:03.491641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 114/216] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:03 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:49:03.514834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64a1d7-3905-4c42-a668-c1dde2b5c358 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:03.542405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76709993-7863-471e-af94-117ecae044ab None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.542605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76709993-7863-471e-af94-117ecae044ab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.542855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76709993-7863-471e-af94-117ecae044ab None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.544638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 115/217] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:03.550304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fbe2f-8b59-41fe-9fb8-e0ab6e968dd7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.550610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fbe2f-8b59-41fe-9fb8-e0ab6e968dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.550848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fbe2f-8b59-41fe-9fb8-e0ab6e968dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.556943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:03.557880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.558343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.558615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] PATH_INFO: `/v3/users/895bfe78e2704377b228ce0e50de8497` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.570341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c57fbe2f-8b59-41fe-9fb8-e0ab6e968dd7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:03.572181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c57fbe2f-8b59-41fe-9fb8-e0ab6e968dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:03.574166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] RBAC: Authorizing `identity:get_user(user_id=895bfe78e2704377b228ce0e50de8497)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:03.576165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:03.578472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 103/218] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:03 2022] GET /identity/v3/users/895bfe78e2704377b228ce0e50de8497 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:03.587835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:03.637454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:03.674372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 116/219] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:03.720848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1909f6-a48d-4bda-a8d9-cbf5926c68d9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:03.763530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:03.763530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.763530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.763530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.797658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f151a3-4edf-4045-baf6-03f270ccfc5d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.798051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f151a3-4edf-4045-baf6-03f270ccfc5d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.798322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f151a3-4edf-4045-baf6-03f270ccfc5d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.800285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 117/220] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:03.806140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67a48-b2c1-42d8-85a6-75d4572e8cc1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:03.806410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67a48-b2c1-42d8-85a6-75d4572e8cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:03.806671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67a48-b2c1-42d8-85a6-75d4572e8cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:03.837571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b3c67a48-b2c1-42d8-85a6-75d4572e8cc1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:03.838776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3c67a48-b2c1-42d8-85a6-75d4572e8cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:03.857661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:03.859122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:03.913494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:03.937759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 118/221] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:03.956993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c67a48-b2c1-42d8-85a6-75d4572e8cc1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:03.974222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:03.994539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 104/222] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:04.000547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.070384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c67a48-b2c1-42d8-85a6-75d4572e8cc1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.105910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e694b8e-1855-455e-8186-bc51405b1913 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.106778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.107595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.108048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.108501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.121187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:04.126683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:04.127587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:04.128367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:04.130656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 119/223] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:04.136537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.169108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.169760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.170043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.170311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.171501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:04.172964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:04.174898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 105/224] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:03 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:04.180592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.187505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:04.234089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:04.266744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352dc1-b4cd-4662-b8b8-266d60d1a1c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.302690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.303262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.303532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.303794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.304461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:04.304756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:04.306233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:04.315739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 120/225] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:04.316667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.343951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a5c0e-ec10-4622-8481-0f32ceb2a202 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.380370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.381237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.381347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.381590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.382324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=895bfe78e2704377b228ce0e50de8497) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:04.382735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:04.384162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:04.397311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 106/226] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:04 2022] GET /identity/v3/role_assignments?user.id=895bfe78e2704377b228ce0e50de8497&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:04.398319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.449135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7156c-54f8-4b16-a29d-f2c54d2e7f50 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.493922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.495261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.495719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.496160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.500363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:04.511524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:04.516839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:04.522600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:04.523520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:04.524287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:04.535947 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 121/227] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:04.541834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.597088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb0877-5e63-47c7-a630-d62b4a5bd101 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.686988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.687625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.687906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.688174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] PATH_INFO: `/v3/users/58b4fd8cdcd642769441090a346787ec` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.691470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b952a37-2dcb-4fa5-8716-626e94e43089 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.693067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] RBAC: Authorizing `identity:get_user(user_id=58b4fd8cdcd642769441090a346787ec)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:04.695230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:04.696295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 107/228] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:04 2022] GET /identity/v3/users/58b4fd8cdcd642769441090a346787ec => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:04.703573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.760286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.760932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.761206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.761466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.762140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:04.762432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:04.763929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:04.777957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 122/229] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:04.783681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.875950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6930c9-30a9-4aec-acec-6c73a38f4edb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:04.904105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:04.911070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:04.911719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:04.911992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:04.912256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:04.913518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:04.915106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:04.916750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 108/230] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:04 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:04.923391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:04.926451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:05.032290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb86af1-ebf8-4aa1-a5d1-ef73879e796d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:05.042726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576cdab-3e11-4cfc-9d41-7f67e986c476 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:05.068520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:05.069337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:05.069618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:05.069885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/58b4fd8cdcd642769441090a346787ec/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:05.071887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] RBAC: Authorizing `identity:create_grant(project_id=ed0e0a7a14f34b2b98697929af5edbc5, user_id=58b4fd8cdcd642769441090a346787ec, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:05.073727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:05.089012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 109/231] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:04 2022] PUT /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/58b4fd8cdcd642769441090a346787ec/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:05.130772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:05.131767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:05.132244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:05.132730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] PATH_INFO: `/v3/users/58b4fd8cdcd642769441090a346787ec` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:05.134216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] RBAC: Authorizing `identity:get_user(user_id=58b4fd8cdcd642769441090a346787ec)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:05.135917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:05.137921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 123/232] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:04 2022] GET /identity/v3/users/58b4fd8cdcd642769441090a346787ec => generated 283 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:05.143829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:05.235794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:05.285151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61b0c3-c091-4745-a245-876ab335834f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:05.323792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428882b2-2260-44b3-88c8-a3f4de24083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:05.324438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428882b2-2260-44b3-88c8-a3f4de24083a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:05.324713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428882b2-2260-44b3-88c8-a3f4de24083a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:05.325008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428882b2-2260-44b3-88c8-a3f4de24083a None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:05.326259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428882b2-2260-44b3-88c8-a3f4de24083a None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:05.327755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428882b2-2260-44b3-88c8-a3f4de24083a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:05.329482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 110/233] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:05 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:05.337123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:05.445518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72ba37-5fa5-45f2-a456-dd299a03e69e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:05.471838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:05.481446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f68e65-7189-4092-8aed-9848648823cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:05.482108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f68e65-7189-4092-8aed-9848648823cc None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:05.482382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f68e65-7189-4092-8aed-9848648823cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:05.482647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f68e65-7189-4092-8aed-9848648823cc None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/58b4fd8cdcd642769441090a346787ec/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:05.484873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f68e65-7189-4092-8aed-9848648823cc None admin] RBAC: Authorizing `identity:create_grant(project_id=ed0e0a7a14f34b2b98697929af5edbc5, user_id=58b4fd8cdcd642769441090a346787ec, role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:05.486320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f68e65-7189-4092-8aed-9848648823cc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:05.501849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 124/234] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:05 2022] PUT /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/58b4fd8cdcd642769441090a346787ec/roles/407978df648d44abb9a8aafed3b0793f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:05.774599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb026cf-dd68-4656-8baa-606a81f827c3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:05.775033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb026cf-dd68-4656-8baa-606a81f827c3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:05.775337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb026cf-dd68-4656-8baa-606a81f827c3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:05.776865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 111/235] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:05.782581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53336-10ff-48fd-9cd6-7ea51bd272a3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:05.783455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53336-10ff-48fd-9cd6-7ea51bd272a3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:05.783924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53336-10ff-48fd-9cd6-7ea51bd272a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:05.803430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c8f53336-10ff-48fd-9cd6-7ea51bd272a3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:05.805039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c8f53336-10ff-48fd-9cd6-7ea51bd272a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:05.894109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 125/236] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:06.212642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb026cf-dd68-4656-8baa-606a81f827c3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:06.340559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc468-b821-4705-9da0-c10737a4f2cd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:06.341315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc468-b821-4705-9da0-c10737a4f2cd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:06.341825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc468-b821-4705-9da0-c10737a4f2cd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:06.343415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 126/237] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:06.348174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4009b-bd80-46b2-b1fe-73611214f2ce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:06.348672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4009b-bd80-46b2-b1fe-73611214f2ce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:06.349291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4009b-bd80-46b2-b1fe-73611214f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:06.370942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-07a4009b-bd80-46b2-b1fe-73611214f2ce None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:06.372192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-07a4009b-bd80-46b2-b1fe-73611214f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:06.373523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb026cf-dd68-4656-8baa-606a81f827c3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:06.433181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:06.441096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:06.441794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:06.442074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:06.442343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:06.461415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:06.471310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:06.472157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:06.472970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 112/238] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:06.480105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:06.481879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 127/239] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:06.616828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78704f-5688-4c81-a54c-3675d2428d85 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:06.650599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44699192-b53c-4f0b-b9d7-59df33edf9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:06.651215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699192-b53c-4f0b-b9d7-59df33edf9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:06.651537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699192-b53c-4f0b-b9d7-59df33edf9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:06.651802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44699192-b53c-4f0b-b9d7-59df33edf9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:06.652504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699192-b53c-4f0b-b9d7-59df33edf9c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:06.652819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699192-b53c-4f0b-b9d7-59df33edf9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:06.654266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44699192-b53c-4f0b-b9d7-59df33edf9c7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:06.664769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 113/240] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:06.670692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4009b-bd80-46b2-b1fe-73611214f2ce None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:06.723465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9baa-ea96-4bff-9ff6-7e6e3289ad40 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:06.723649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9baa-ea96-4bff-9ff6-7e6e3289ad40 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:06.723916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9baa-ea96-4bff-9ff6-7e6e3289ad40 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:06.725355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 114/241] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:06.739292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac491b5-cd01-470a-ae30-bdfda0e09a32 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:06.739599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac491b5-cd01-470a-ae30-bdfda0e09a32 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:06.739846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac491b5-cd01-470a-ae30-bdfda0e09a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:06.740163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:06.776931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bac491b5-cd01-470a-ae30-bdfda0e09a32 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:06.778171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bac491b5-cd01-470a-ae30-bdfda0e09a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:06.794779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4009b-bd80-46b2-b1fe-73611214f2ce None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:06.846126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:06.846854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:06.847024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:06.847300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] PATH_INFO: `/v3/users/5e8252717d9a48038c4cbb14573c9f41` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:06.863393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8252717d9a48038c4cbb14573c9f41)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:06.864063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:06.864896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:06.867117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 128/242] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:06 2022] GET /identity/v3/users/5e8252717d9a48038c4cbb14573c9f41 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:06.867897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:06.895427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 115/243] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:06.896331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac491b5-cd01-470a-ae30-bdfda0e09a32 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:06.992691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9dcda-795c-4e6e-92a7-81ee2db69597 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:06.996789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:07.021773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac491b5-cd01-470a-ae30-bdfda0e09a32 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:07.045343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.046377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.046848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.047328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.049864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:07.052466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:07.055160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 129/244] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:07.062040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:07.076389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.077221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.077497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.077762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.172338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:07.206554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:07.208029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:07.271665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec462b0-5fa2-4d2e-af6f-1e672793f393 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:07.314393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.315450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.315895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.316343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.317509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:07.320041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:07.353275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 130/245] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:07 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:49:07.354381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:07.380788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 116/246] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:07.389948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:07.400861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:07.485557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e07ea-5492-411f-beb7-01e7f9b51d58 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:07.529916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.530659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.530941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.531217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.542822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:07.548021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:07.548924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:07.549867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 131/247] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:07.555052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:07.557415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:07.580454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4bf2-0a1e-4135-88f7-f5e694fa5f15 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:07.622266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.623093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.623475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.623843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.625495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:07.627036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:07.628821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 117/248] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:07 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:07.636730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:07.654062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:07.667078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159d32f-ce61-499e-abfa-5d4037e8e391 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:07.703333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.703943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.704220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.704544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.707788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:07.707788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:07.707788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:07.716359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 132/249] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:07.722043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:07.774153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f54f-2aa1-49fb-866e-ced7b283ed80 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:07.820745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94714151-f50b-4d9a-960c-7ca8e6fdda8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.821335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94714151-f50b-4d9a-960c-7ca8e6fdda8a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.821610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94714151-f50b-4d9a-960c-7ca8e6fdda8a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.821878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94714151-f50b-4d9a-960c-7ca8e6fdda8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.822775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94714151-f50b-4d9a-960c-7ca8e6fdda8a None admin] RBAC: Adding query filter params (role.id=9b29ff5da37348b084fb11e2a3e687eb, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=5e8252717d9a48038c4cbb14573c9f41) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:07.823087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94714151-f50b-4d9a-960c-7ca8e6fdda8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:07.825504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94714151-f50b-4d9a-960c-7ca8e6fdda8a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:07.832295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 118/250] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:07 2022] GET /identity/v3/role_assignments?user.id=5e8252717d9a48038c4cbb14573c9f41&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=9b29ff5da37348b084fb11e2a3e687eb => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:07.834744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2fa03-a433-4b83-9086-41bde6558a7f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.834744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2fa03-a433-4b83-9086-41bde6558a7f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.835012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2fa03-a433-4b83-9086-41bde6558a7f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.836939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 119/251] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:07.844223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f0864-c933-4fa7-a74b-553224330152 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.844668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f0864-c933-4fa7-a74b-553224330152 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.845098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f0864-c933-4fa7-a74b-553224330152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.877437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d35e7-4be4-431d-ac3e-dc6b87638edc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:07.877951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7d1f0864-c933-4fa7-a74b-553224330152 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:07.878664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7d1f0864-c933-4fa7-a74b-553224330152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:07.892409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:07.926551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:07.927208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:07.927584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:07.927858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] PATH_INFO: `/v3/users/895bfe78e2704377b228ce0e50de8497` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:07.929042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] RBAC: Authorizing `identity:get_user(user_id=895bfe78e2704377b228ce0e50de8497)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:07.931706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:07.933919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 133/252] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:07 2022] GET /identity/v3/users/895bfe78e2704377b228ce0e50de8497 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:07.940433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:07.967297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:07.976853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 120/253] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:08.015152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7c2c3-3da8-493d-9394-b6a62ecddef6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.015469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7c2c3-3da8-493d-9394-b6a62ecddef6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.015699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7c2c3-3da8-493d-9394-b6a62ecddef6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.017481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 121/254] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:08.026408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bba05-2896-4731-8fa9-02068bc06d5c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.027025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bba05-2896-4731-8fa9-02068bc06d5c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.027484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bba05-2896-4731-8fa9-02068bc06d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.048602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-970bba05-2896-4731-8fa9-02068bc06d5c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:08.050405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-970bba05-2896-4731-8fa9-02068bc06d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:08.060994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba93b1-9a17-4d5b-a75b-bd3494be2b13 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:08.104620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:08.105201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.105478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.105747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.107123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:08.109025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:08.111303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 134/255] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:07 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:08.117077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:08.135253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 122/256] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:08.211629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:08.227766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d1543-e671-4866-9f7f-1f9a611b6172 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:08.265791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:08.266457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.267036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.267311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/895bfe78e2704377b228ce0e50de8497/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.267893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bba05-2896-4731-8fa9-02068bc06d5c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:08.269319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed0e0a7a14f34b2b98697929af5edbc5, user_id=895bfe78e2704377b228ce0e50de8497, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:08.270789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:08.305423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 135/257] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:08 2022] PUT /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/895bfe78e2704377b228ce0e50de8497/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:49:08.385614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:08.414601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bba05-2896-4731-8fa9-02068bc06d5c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:08.451689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:08.452397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.452672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.452968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.464681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:08.470027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:08.470879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:08.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:08.476331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 123/258] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:08.477945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:08.599975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f6e5-c70e-40f9-956a-c34b4fc40e41 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:08.640139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:08.655142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:08.655757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.656092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.656358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.657060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:08.657355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:08.658998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:08.681217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 136/259] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:08.701774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:08.714487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:08.823965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f73c-5dd0-4927-b896-bcfa06046f15 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:08.880247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f48da-6323-4729-a97a-9e6b7218a3c1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:08.890576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:08.891147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.891419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.891682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.893870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:08.907952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:08.913583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:08.914512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:08.915289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 124/260] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:08.927823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:08.956715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:08.957364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:08.957634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:08.957899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] PATH_INFO: `/v3/users/58b4fd8cdcd642769441090a346787ec` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:08.959758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] RBAC: Authorizing `identity:get_user(user_id=58b4fd8cdcd642769441090a346787ec)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:08.961310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:08.969964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 137/261] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:08 2022] GET /identity/v3/users/58b4fd8cdcd642769441090a346787ec => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:08.973866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:09.118166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:09.129971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fef6e-22d7-4d30-8fa9-8b96a7feba3a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:09.163400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bd275-3514-4fd3-921e-722f5087012e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:09.196307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:09.196961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:09.197231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:09.197494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:09.198165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:09.198457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:09.199841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:09.217265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 125/262] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:09.223443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:09.224438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:09.225074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:09.225347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:09.225608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:09.327264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:09.373523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:09.375094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:09.381203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a33a5-4ed5-4181-9764-99804acd98ff None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:09.428564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:09.429313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:09.429470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:09.429675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] PATH_INFO: `/v3/users/58b4fd8cdcd642769441090a346787ec` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:09.433420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] RBAC: Authorizing `identity:get_user(user_id=58b4fd8cdcd642769441090a346787ec)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:09.435241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:09.437500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 126/263] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:09 2022] GET /identity/v3/users/58b4fd8cdcd642769441090a346787ec => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:09.444341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:09.573366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:09.584332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbceb29-3569-4cbf-bc9b-6024e67bdec1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:09.609270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:09.611475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 138/264] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:09.617134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:09.630139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:09.630811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:09.631087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:09.631352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:09.723034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51597b-2340-456c-9971-8c9912543a22 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:09.768904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:09.769582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:09.769853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:09.770116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:09.771484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:09.772961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:09.779613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 139/265] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:09 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:09.780933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:09.798022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:09.799810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:09.829201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:09.885435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581be2-63ed-4dad-b970-aff836fce87d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:09.961548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:09.962507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:09.963003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:09.963468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:09.964674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=58b4fd8cdcd642769441090a346787ec) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:09.966648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:09.968309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:09.980911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 127/266] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:49:09.983784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:09.991214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 140/267] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:09 2022] GET /identity/v3/role_assignments?user.id=58b4fd8cdcd642769441090a346787ec&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:10.024489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:10.128752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373b80-3855-4b86-966a-42256104cdbf None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:10.176829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201b15-ec48-42e0-9934-32db3a4feaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:10.177552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201b15-ec48-42e0-9934-32db3a4feaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.177832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201b15-ec48-42e0-9934-32db3a4feaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.178101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201b15-ec48-42e0-9934-32db3a4feaa9 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.179343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201b15-ec48-42e0-9934-32db3a4feaa9 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:10.180906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201b15-ec48-42e0-9934-32db3a4feaa9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:10.182739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 128/268] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:09 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:10.189335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:10.325061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220bbd0-8c7c-49ec-a139-54277a02f315 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:10.341865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:10.371116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa21ef-aeb5-4b87-a949-8e9e0a1d11cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:10.371730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa21ef-aeb5-4b87-a949-8e9e0a1d11cb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.372038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa21ef-aeb5-4b87-a949-8e9e0a1d11cb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.372368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa21ef-aeb5-4b87-a949-8e9e0a1d11cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.373062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa21ef-aeb5-4b87-a949-8e9e0a1d11cb None admin] RBAC: Adding query filter params (role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=58b4fd8cdcd642769441090a346787ec) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:10.373371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa21ef-aeb5-4b87-a949-8e9e0a1d11cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:10.374824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa21ef-aeb5-4b87-a949-8e9e0a1d11cb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:10.385632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 141/269] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:10 2022] GET /identity/v3/role_assignments?user.id=58b4fd8cdcd642769441090a346787ec&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=407978df648d44abb9a8aafed3b0793f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:10.597872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02712b0b-887b-4b3c-95fa-ce9941c6c5b7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.597872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02712b0b-887b-4b3c-95fa-ce9941c6c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.597872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02712b0b-887b-4b3c-95fa-ce9941c6c5b7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.597872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 129/270] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:10.604288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0202a-e55f-4328-83d8-e18af57b0cef None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.604578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0202a-e55f-4328-83d8-e18af57b0cef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.604899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0202a-e55f-4328-83d8-e18af57b0cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.634012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-52f0202a-e55f-4328-83d8-e18af57b0cef None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:10.635261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-52f0202a-e55f-4328-83d8-e18af57b0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:10.721241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 142/271] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:10.770324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d94e-da6d-424b-8cfd-da9407371208 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.770743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d94e-da6d-424b-8cfd-da9407371208 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.771142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d94e-da6d-424b-8cfd-da9407371208 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.772956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 130/272] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:10.777921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53a642-5465-4571-af1f-a12848d11d8e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.779396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53a642-5465-4571-af1f-a12848d11d8e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.779820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53a642-5465-4571-af1f-a12848d11d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.802526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-af53a642-5465-4571-af1f-a12848d11d8e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:10.803936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-af53a642-5465-4571-af1f-a12848d11d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:10.845201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269c6b-9d90-426c-8fb9-29f9f214ba3d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.845809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269c6b-9d90-426c-8fb9-29f9f214ba3d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.846294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269c6b-9d90-426c-8fb9-29f9f214ba3d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.847831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 131/273] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:10.853213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4756-15b6-48cf-8f56-09d18aabef7f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:10.854384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4756-15b6-48cf-8f56-09d18aabef7f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:10.854880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4756-15b6-48cf-8f56-09d18aabef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:10.881727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-803e4756-15b6-48cf-8f56-09d18aabef7f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:10.883339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-803e4756-15b6-48cf-8f56-09d18aabef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:10.895225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 143/274] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:10.964569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 132/275] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:11.012827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53a642-5465-4571-af1f-a12848d11d8e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.046649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:11.124987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53a642-5465-4571-af1f-a12848d11d8e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.159260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.159884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.160154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.160414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.171141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:11.173148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e4756-15b6-48cf-8f56-09d18aabef7f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:11.176082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:11.177192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:11.178047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 144/276] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:11.183000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.205959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:11.284404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:11.294012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36031135-c1d3-404e-92d2-c9ee1a736fb8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.311692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e4756-15b6-48cf-8f56-09d18aabef7f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.330750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.331346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.331617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.331881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.332540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:11.332857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:11.334298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:11.342672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 145/277] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:11.343451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.345793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2d6f3-0cb8-49e2-af7d-1f81435a1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.346433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2d6f3-0cb8-49e2-af7d-1f81435a1f4e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.346710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2d6f3-0cb8-49e2-af7d-1f81435a1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.346976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2d6f3-0cb8-49e2-af7d-1f81435a1f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.348101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2d6f3-0cb8-49e2-af7d-1f81435a1f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:11.349549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2d6f3-0cb8-49e2-af7d-1f81435a1f4e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:11.351120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 133/278] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:11.352228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550b87-ce1e-42d6-aea4-0bae72066f11 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.352503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550b87-ce1e-42d6-aea4-0bae72066f11 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.352780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550b87-ce1e-42d6-aea4-0bae72066f11 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.354226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 134/279] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:11.354923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550b87-ce1e-42d6-aea4-0bae72066f11 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.447244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08daa6-2a05-4e61-b4a6-d66bf62f2789 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.450922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:11.463493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550b87-ce1e-42d6-aea4-0bae72066f11 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.481915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.482540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.482812 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.483075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.493801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:11.496777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433115ef-d53a-4aa1-8b2c-7c0fd659bd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.497501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433115ef-d53a-4aa1-8b2c-7c0fd659bd46 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.497775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433115ef-d53a-4aa1-8b2c-7c0fd659bd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.498045 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433115ef-d53a-4aa1-8b2c-7c0fd659bd46 None admin] PATH_INFO: `/v3/users/52c5917add38412482a9b7fcb444724e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:11.499270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:11.500234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:11.501045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 146/280] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:11.501680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.513253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433115ef-d53a-4aa1-8b2c-7c0fd659bd46 None admin] RBAC: Authorizing `identity:get_user(user_id=52c5917add38412482a9b7fcb444724e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:11.514712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433115ef-d53a-4aa1-8b2c-7c0fd659bd46 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:11.516406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 135/281] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/users/52c5917add38412482a9b7fcb444724e => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:11.517595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bae611-7e78-4e02-96d4-94b1a0c6dc66 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.517869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bae611-7e78-4e02-96d4-94b1a0c6dc66 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.518137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bae611-7e78-4e02-96d4-94b1a0c6dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.522162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:11.539405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-20bae611-7e78-4e02-96d4-94b1a0c6dc66 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:11.540680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-20bae611-7e78-4e02-96d4-94b1a0c6dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:11.606874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d322ce-4199-4e93-9805-d35692277984 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.620909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 136/282] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:11.620909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bae611-7e78-4e02-96d4-94b1a0c6dc66 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.641460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.642070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.642345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.642614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.643256 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:11.644701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:11.668055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 147/283] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:11 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:11.668925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.711800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:11.738073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bae611-7e78-4e02-96d4-94b1a0c6dc66 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.781799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.782825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.783243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.783648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.784458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:11.784928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:11.786663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:11.794656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:11.800882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 137/284] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:11.807806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.845108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085a47b-a25c-4b41-8992-a1c731c80ac8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.888253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.888931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.889396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.889766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:11.890735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, user.id=52c5917add38412482a9b7fcb444724e, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:11.891029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:11.892965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:11.898674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 148/285] 10.222.0.89 () {56 vars in 1308 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/role_assignments?user.id=52c5917add38412482a9b7fcb444724e&scope.system=all&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:11.899534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:11.949372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5c42-e540-46d9-aede-23ba579e0501 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:11.996699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:11.998016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:11.998304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:11.998577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] PATH_INFO: `/v3/users/5e8252717d9a48038c4cbb14573c9f41` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:12.000191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8252717d9a48038c4cbb14573c9f41)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:12.002030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:12.003866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 138/286] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/users/5e8252717d9a48038c4cbb14573c9f41 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:12.009468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:12.023434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:12.031862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a0c8-0fef-4175-bf6b-eec17a4c14b2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:12.082831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:12.083653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:12.083931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:12.084201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:12.087534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:12.103786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:12.110511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:12.111380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:12.112148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:12.114935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 149/287] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:12.123238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:12.142343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec477b-5a32-4d63-8cf2-9631ae703782 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:12.189370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:12.190254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:12.190681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:12.190950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:12.193528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:12.195410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:12.197333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 139/288] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:12 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:12.204036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:12.254972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2862f-8f77-44d1-b22f-078649079211 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:12.293273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:12.296865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:12.297485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:12.297759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:12.298026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:12.298951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:12.299250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:12.300785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:12.313016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 150/289] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:12.319159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:12.324163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9b9c6-c7b1-4c99-866a-971f4f53d949 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:12.361181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:12.362229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:12.362720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:12.363211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/5e8252717d9a48038c4cbb14573c9f41/roles/9b29ff5da37348b084fb11e2a3e687eb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:12.365440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed0e0a7a14f34b2b98697929af5edbc5, user_id=5e8252717d9a48038c4cbb14573c9f41, role_id=9b29ff5da37348b084fb11e2a3e687eb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:12.367303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:12.383700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 140/290] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:12 2022] PUT /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/users/5e8252717d9a48038c4cbb14573c9f41/roles/9b29ff5da37348b084fb11e2a3e687eb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:49:12.438239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:12.492948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d3058-5eda-4606-ad9e-beb0685fea6e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:12.532229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:12.532824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:12.533123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:12.533403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] PATH_INFO: `/v3/users/895bfe78e2704377b228ce0e50de8497` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:12.534578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] RBAC: Authorizing `identity:get_user(user_id=895bfe78e2704377b228ce0e50de8497)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:12.536120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:12.538978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 151/291] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:12 2022] GET /identity/v3/users/895bfe78e2704377b228ce0e50de8497 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:12.545508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:12.661521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663afa-ffd9-4475-b14a-74bb855157b8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:12.698700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:12.699730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:12.700279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:12.700749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:12.704831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:12.774928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:12.776410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:12.924007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 141/292] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:12.929696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:13.083741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f8737-c762-4924-b1d0-9e0846b2aacb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:13.121082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:13.132843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0cf70-e65f-46a6-af39-f1be80792bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:13.133812 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cf70-e65f-46a6-af39-f1be80792bdd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:13.134288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cf70-e65f-46a6-af39-f1be80792bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:13.134756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cf70-e65f-46a6-af39-f1be80792bdd None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:13.136083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0cf70-e65f-46a6-af39-f1be80792bdd None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:13.137832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0cf70-e65f-46a6-af39-f1be80792bdd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:13.144746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 152/293] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:12 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:13.150091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:13.201888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:13.281022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac34a52-037b-4600-a64f-a6e541b1b7a9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:13.323273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7950f4-9824-4427-a21d-18d358be7776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:13.323882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7950f4-9824-4427-a21d-18d358be7776 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:13.324156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7950f4-9824-4427-a21d-18d358be7776 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:13.324425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7950f4-9824-4427-a21d-18d358be7776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:13.325210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7950f4-9824-4427-a21d-18d358be7776 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=895bfe78e2704377b228ce0e50de8497) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:13.325517 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7950f4-9824-4427-a21d-18d358be7776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:13.326960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7950f4-9824-4427-a21d-18d358be7776 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:13.333226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 142/294] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:13 2022] GET /identity/v3/role_assignments?user.id=895bfe78e2704377b228ce0e50de8497&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:14.076412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cadec-7599-45e3-a9a6-da12b27194b6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.076928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cadec-7599-45e3-a9a6-da12b27194b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.076928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cadec-7599-45e3-a9a6-da12b27194b6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.078544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 153/295] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:14.084364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769250-b008-4cb1-9b2e-b076fc045e2b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.085271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769250-b008-4cb1-9b2e-b076fc045e2b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.085791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769250-b008-4cb1-9b2e-b076fc045e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.105390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7d769250-b008-4cb1-9b2e-b076fc045e2b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:14.107329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7d769250-b008-4cb1-9b2e-b076fc045e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:14.180928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 143/296] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:14.199549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca797f-ef8e-4a59-844f-688380781c2d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.199830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca797f-ef8e-4a59-844f-688380781c2d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.200317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca797f-ef8e-4a59-844f-688380781c2d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.201978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 154/297] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:14.207614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf83a-844f-4b7e-bec4-e3ca447df34b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.207900 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf83a-844f-4b7e-bec4-e3ca447df34b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.208168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf83a-844f-4b7e-bec4-e3ca447df34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.226881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ebedf83a-844f-4b7e-bec4-e3ca447df34b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:14.228101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ebedf83a-844f-4b7e-bec4-e3ca447df34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:14.253030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:14.301293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 144/298] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:14.453641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca797f-ef8e-4a59-844f-688380781c2d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:14.480520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7f46-52dd-4e13-95d9-636aa7ad32c8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.480906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7f46-52dd-4e13-95d9-636aa7ad32c8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.481165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7f46-52dd-4e13-95d9-636aa7ad32c8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.482822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 145/299] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:14.488129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7631-8222-4781-a3e7-626c4fd7566e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.488412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7631-8222-4781-a3e7-626c4fd7566e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.488687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7631-8222-4781-a3e7-626c4fd7566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.508317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b30a7631-8222-4781-a3e7-626c4fd7566e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:14.509598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b30a7631-8222-4781-a3e7-626c4fd7566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:14.565385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca797f-ef8e-4a59-844f-688380781c2d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:14.580406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 146/300] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:14.589782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7631-8222-4781-a3e7-626c4fd7566e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:14.602062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:14.602717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.602998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.603270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.615658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:14.620980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:14.621956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:14.622741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:14.627337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 155/301] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:14.628752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:14.689433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:14.704984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:14.716036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7631-8222-4781-a3e7-626c4fd7566e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:14.736396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5d7d-b5b4-474b-8c19-bfb42cf436f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:14.760865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4114-5896-4203-93f0-03b0d03e1d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:14.761516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4114-5896-4203-93f0-03b0d03e1d27 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.761794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4114-5896-4203-93f0-03b0d03e1d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.762062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4114-5896-4203-93f0-03b0d03e1d27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.772664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e4114-5896-4203-93f0-03b0d03e1d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:14.773297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063cdfc-515e-443b-85d9-203006c258b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:14.773965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cdfc-515e-443b-85d9-203006c258b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.774318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cdfc-515e-443b-85d9-203006c258b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.774651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063cdfc-515e-443b-85d9-203006c258b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.775383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063cdfc-515e-443b-85d9-203006c258b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:14.775736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063cdfc-515e-443b-85d9-203006c258b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:14.777172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063cdfc-515e-443b-85d9-203006c258b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-cd7e4114-5896-4203-93f0-03b0d03e1d27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:14.777481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:14.778592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:14.779377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 147/302] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:14.780728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73240-242b-4bf6-bca1-d87b2ed5d6e2 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.780728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73240-242b-4bf6-bca1-d87b2ed5d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.780962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73240-242b-4bf6-bca1-d87b2ed5d6e2 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.782359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 148/303] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:14.787965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb73240-242b-4bf6-bca1-d87b2ed5d6e2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:14.800419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 156/304] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:14.800419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e7db-9771-4f03-81d9-c85ec3a53956 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.800419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e7db-9771-4f03-81d9-c85ec3a53956 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.800419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e7db-9771-4f03-81d9-c85ec3a53956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.816163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6913e7db-9771-4f03-81d9-c85ec3a53956 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:14.817565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6913e7db-9771-4f03-81d9-c85ec3a53956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:14.885556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 157/305] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:14.886383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e7db-9771-4f03-81d9-c85ec3a53956 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:14.899268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb73240-242b-4bf6-bca1-d87b2ed5d6e2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:14.936639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:14.936946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:14.937474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:14.938520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:14.939141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:14.940083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:14.940385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:14.941772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:14.949974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 149/306] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:14.949974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:14.970028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:15.002818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e7db-9771-4f03-81d9-c85ec3a53956 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.039268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.039949 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.040233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.040511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] PATH_INFO: `/v3/users/fb2afdc3cf74428cb60099d161c84d07` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.057236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] RBAC: Authorizing `identity:get_user(user_id=fb2afdc3cf74428cb60099d161c84d07)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.058848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.060582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 158/307] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:14 2022] GET /identity/v3/users/fb2afdc3cf74428cb60099d161c84d07 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:15.061388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.062662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e945-04a6-4b57-a76f-061d3f19a5b9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.101993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335af9-6802-43d1-9865-225efa71891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.103383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335af9-6802-43d1-9865-225efa71891a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.103842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335af9-6802-43d1-9865-225efa71891a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.104254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335af9-6802-43d1-9865-225efa71891a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.105671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335af9-6802-43d1-9865-225efa71891a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.107426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335af9-6802-43d1-9865-225efa71891a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.109575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 150/308] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:15.110497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335af9-6802-43d1-9865-225efa71891a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.167881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d614cb-4407-4a80-a819-cd40a713329b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.169516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:15.198519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:15.201870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.202837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.203085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.203378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] PATH_INFO: `/v3/users/52c5917add38412482a9b7fcb444724e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.204762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] RBAC: Authorizing `identity:get_user(user_id=52c5917add38412482a9b7fcb444724e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.206402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.208029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 159/309] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:15 2022] GET /identity/v3/users/52c5917add38412482a9b7fcb444724e => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:15.208727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.220827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335af9-6802-43d1-9865-225efa71891a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.255120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.255729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.256010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.256278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.257065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] RBAC: Adding query filter params (role.id=9b29ff5da37348b084fb11e2a3e687eb, user.id=fb2afdc3cf74428cb60099d161c84d07, scope.system=all) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:15.257371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.258796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.264079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 151/310] 10.222.0.89 () {56 vars in 1308 bytes} [Tue Aug 30 00:49:15 2022] GET /identity/v3/role_assignments?user.id=fb2afdc3cf74428cb60099d161c84d07&scope.system=all&role.id=9b29ff5da37348b084fb11e2a3e687eb => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:15.264767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.324176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e539da-8354-43db-b841-f49db86f8221 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.368358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.369237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.369516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.369794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] PATH_INFO: `/v3/groups` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.370442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.372191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.388931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62503f86-5193-43b1-9abe-18781ec1d8bb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.390553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 160/311] 10.222.0.89 () {60 vars in 1134 bytes} [Tue Aug 30 00:49:15 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:15.397119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.441179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:15.453469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.454465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.454756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.455034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.474400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:15.485806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:15.486830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:15.487630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 152/312] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:15.494747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.501272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:15.550529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f144c59-7755-47b6-8469-9b3b30cb2824 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.595006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.596018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.596123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.597007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] PATH_INFO: `/v3/system/users/52c5917add38412482a9b7fcb444724e/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.600217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=52c5917add38412482a9b7fcb444724e, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.601345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.612885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 161/313] 10.222.0.89 () {58 vars in 1334 bytes} [Tue Aug 30 00:49:15 2022] PUT /identity/v3/system/users/52c5917add38412482a9b7fcb444724e/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:15.634166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd2839-5066-4239-ae0f-e7b8e586d9ed None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.675550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.676188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.676467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.676741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.677463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:15.677768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.679233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.689676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 153/314] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:15.695828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.816567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:15.826300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e72c6-056d-44dd-8e49-138164abd54e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:15.862596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:15.863286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:15.863563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:15.863835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] PATH_INFO: `/v3/users/5e8252717d9a48038c4cbb14573c9f41` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:15.865058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8252717d9a48038c4cbb14573c9f41)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:15.866578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:15.868159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 162/315] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:15 2022] GET /identity/v3/users/5e8252717d9a48038c4cbb14573c9f41 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:15.877946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:15.949688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:15.986391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d145cd-46a9-42f1-95d6-2615155aa1e6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:16.021392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:16.021948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:16.022225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:16.022497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:16.090829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:16.092282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:16.157811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:16.194434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 154/316] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:16.200352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:16.308480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e324d-1946-43e7-b6ea-5a9f7c845d78 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:16.345725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211ef10-ba03-402d-8462-e9c7e1aad6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:16.346355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211ef10-ba03-402d-8462-e9c7e1aad6ab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:16.346632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211ef10-ba03-402d-8462-e9c7e1aad6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:16.346903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211ef10-ba03-402d-8462-e9c7e1aad6ab None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:16.348029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211ef10-ba03-402d-8462-e9c7e1aad6ab None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:16.349510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211ef10-ba03-402d-8462-e9c7e1aad6ab None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:16.351458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 163/317] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:16 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:16.357373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:16.461850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb7bc4-2390-43ab-b22f-c6ed56b10dca None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:16.497199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f99bd-fcc2-4088-9e1e-8cf45216ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:16.497849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f99bd-fcc2-4088-9e1e-8cf45216ba6a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:16.498129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f99bd-fcc2-4088-9e1e-8cf45216ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:16.498404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f99bd-fcc2-4088-9e1e-8cf45216ba6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:16.499196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f99bd-fcc2-4088-9e1e-8cf45216ba6a None admin] RBAC: Adding query filter params (role.id=9b29ff5da37348b084fb11e2a3e687eb, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5, user.id=5e8252717d9a48038c4cbb14573c9f41) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:16.499508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f99bd-fcc2-4088-9e1e-8cf45216ba6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:16.500968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f99bd-fcc2-4088-9e1e-8cf45216ba6a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:16.507312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 155/318] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:16 2022] GET /identity/v3/role_assignments?user.id=5e8252717d9a48038c4cbb14573c9f41&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=9b29ff5da37348b084fb11e2a3e687eb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:17.267909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634590-fcf6-481d-9a90-cc86a6360e17 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.268579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634590-fcf6-481d-9a90-cc86a6360e17 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.268579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634590-fcf6-481d-9a90-cc86a6360e17 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.270014 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 164/319] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:17.275087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128d55-8b66-498b-8f9e-ac8c9dcb9dd2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.275498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128d55-8b66-498b-8f9e-ac8c9dcb9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.275589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128d55-8b66-498b-8f9e-ac8c9dcb9dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.294825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a1128d55-8b66-498b-8f9e-ac8c9dcb9dd2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:17.296042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a1128d55-8b66-498b-8f9e-ac8c9dcb9dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:17.323205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:17.369490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 156/320] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:17.435336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a6ab-fa62-4349-bd8f-7944c3cd3ee7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.435577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a6ab-fa62-4349-bd8f-7944c3cd3ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.435876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a6ab-fa62-4349-bd8f-7944c3cd3ee7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.437432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 165/321] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:17.442600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0f22f-a2a5-4b77-ac9d-84d50a3369cc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.442897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0f22f-a2a5-4b77-ac9d-84d50a3369cc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.443150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0f22f-a2a5-4b77-ac9d-84d50a3369cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.461820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d9a0f22f-a2a5-4b77-ac9d-84d50a3369cc None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:17.463030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d9a0f22f-a2a5-4b77-ac9d-84d50a3369cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:17.535083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 157/322] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:17.630405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a6ab-fa62-4349-bd8f-7944c3cd3ee7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:17.638837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319e38c-8e93-4e7c-a353-93f80ba99a9f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.639120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319e38c-8e93-4e7c-a353-93f80ba99a9f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.639392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319e38c-8e93-4e7c-a353-93f80ba99a9f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.640834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 158/323] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:17.645979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a942-dc30-48db-b389-1d39aea0beea None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.646265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a942-dc30-48db-b389-1d39aea0beea None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.646535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8a942-dc30-48db-b389-1d39aea0beea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.664155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:17.665710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bcf8a942-dc30-48db-b389-1d39aea0beea None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:17.666918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bcf8a942-dc30-48db-b389-1d39aea0beea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:17.740067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 159/324] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:17.743280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a6ab-fa62-4349-bd8f-7944c3cd3ee7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:17.784390 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:17.785043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.785375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.785556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.796219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:17.801511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:17.802375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:17.807604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 166/325] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:17.809867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8a942-dc30-48db-b389-1d39aea0beea None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:17.810130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:17.836752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:17.911039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:17.922265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e3add-4e4e-46b2-ba63-d6f4f28a230e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:17.923951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8a942-dc30-48db-b389-1d39aea0beea None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:17.957004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:17.957610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.957878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.958141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.958798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:17.959087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:17.960457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:17.968958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:17.970002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:17.970277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:17.970543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:17.971788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:17.972641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 167/326] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:17.973273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:17.974938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 160/327] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:17.980176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:17.980294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:18.071350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:18.083920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dff6-6b68-462b-a33e-4c1a68cc8f1a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:18.085504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9201f5-b5f4-4db5-b422-824eebb72cfa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:18.119850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:18.120722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:18.121009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:18.121125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:18.121276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] PATH_INFO: `/v3/groups` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:18.121627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:18.121944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:18.122036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:18.122414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] PATH_INFO: `/v3/users/fb2afdc3cf74428cb60099d161c84d07` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:18.123463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:18.123680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] RBAC: Authorizing `identity:get_user(user_id=fb2afdc3cf74428cb60099d161c84d07)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:18.125200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:18.131334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 168/328] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:17 2022] GET /identity/v3/users/fb2afdc3cf74428cb60099d161c84d07 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:18.131334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:18.144933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 161/329] 10.222.0.89 () {60 vars in 1134 bytes} [Tue Aug 30 00:49:17 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:18.145720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:18.192090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:18.245872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672adc7-d2b8-4d3a-b797-6dde328b4f92 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:18.269247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317f907-b08b-41b3-82a2-a34a34dd9143 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:18.284999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:18.285785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:18.286051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:18.286326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:18.298784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:18.303833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:18.304836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:18.305716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 169/330] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:18.311426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:18.315189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:18.316532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:18.316532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:18.316532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] PATH_INFO: `/v3/system/users/fb2afdc3cf74428cb60099d161c84d07/roles/9b29ff5da37348b084fb11e2a3e687eb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:18.320394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fb2afdc3cf74428cb60099d161c84d07, role_id=9b29ff5da37348b084fb11e2a3e687eb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:18.322037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:18.333252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 162/331] 10.222.0.89 () {58 vars in 1334 bytes} [Tue Aug 30 00:49:18 2022] PUT /identity/v3/system/users/fb2afdc3cf74428cb60099d161c84d07/roles/9b29ff5da37348b084fb11e2a3e687eb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:18.416979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:18.444666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c182a47-11c4-44d0-920d-6d953991bbd8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:18.486058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:18.486675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:18.486952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:18.487217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:18.487895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:18.488192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:18.489684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:18.500125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 170/332] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:18.505604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:18.523473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:18.619946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c518c-064a-4876-8f21-6b8638c4c082 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:18.657100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f580ae-b50f-45ed-a37f-cfeee4664026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:18.657809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f580ae-b50f-45ed-a37f-cfeee4664026 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:18.658092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f580ae-b50f-45ed-a37f-cfeee4664026 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:18.658366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f580ae-b50f-45ed-a37f-cfeee4664026 None admin] PATH_INFO: `/v3/users/52c5917add38412482a9b7fcb444724e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:18.659644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f580ae-b50f-45ed-a37f-cfeee4664026 None admin] RBAC: Authorizing `identity:get_user(user_id=52c5917add38412482a9b7fcb444724e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:18.661203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f580ae-b50f-45ed-a37f-cfeee4664026 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:18.663251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 163/333] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:18 2022] GET /identity/v3/users/52c5917add38412482a9b7fcb444724e => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:18.669262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:18.792715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76fc11-da02-4050-bf73-89f1e69f91c2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:18.834924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d76aa-95d1-4855-9a80-b19e7a6c3ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:18.835569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d76aa-95d1-4855-9a80-b19e7a6c3ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:18.835854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d76aa-95d1-4855-9a80-b19e7a6c3ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:18.836127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d76aa-95d1-4855-9a80-b19e7a6c3ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:18.836903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d76aa-95d1-4855-9a80-b19e7a6c3ab7 None admin] RBAC: Adding query filter params (role.id=ed49631efea14b8fbf4b884c491e4092, user.id=52c5917add38412482a9b7fcb444724e, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:18.837215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d76aa-95d1-4855-9a80-b19e7a6c3ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:18.838678 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d76aa-95d1-4855-9a80-b19e7a6c3ab7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:18.848503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:18.851964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 171/334] 10.222.0.89 () {56 vars in 1308 bytes} [Tue Aug 30 00:49:18 2022] GET /identity/v3/role_assignments?user.id=52c5917add38412482a9b7fcb444724e&scope.system=all&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:20.303036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2fab0-3978-46d1-9999-d51d254e4f51 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:20.303556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2fab0-3978-46d1-9999-d51d254e4f51 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:20.303556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2fab0-3978-46d1-9999-d51d254e4f51 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:20.305351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 164/335] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:20.310594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371a6e-4ae7-4d4b-ad7e-9daa6b950553 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:20.311037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371a6e-4ae7-4d4b-ad7e-9daa6b950553 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:20.311112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371a6e-4ae7-4d4b-ad7e-9daa6b950553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:20.331041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e8371a6e-4ae7-4d4b-ad7e-9daa6b950553 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:20.332243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e8371a6e-4ae7-4d4b-ad7e-9daa6b950553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:20.362198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4c3d-151c-4972-9a8d-0cec01f4903f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:20.362809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4c3d-151c-4972-9a8d-0cec01f4903f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:20.363298 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b4c3d-151c-4972-9a8d-0cec01f4903f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:20.365132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 165/336] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:20.370643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a6c8-b69b-4659-a201-524cba7752b1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:20.370915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a6c8-b69b-4659-a201-524cba7752b1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:20.371191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a6c8-b69b-4659-a201-524cba7752b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:20.398521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8c56a6c8-b69b-4659-a201-524cba7752b1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:20.399779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8c56a6c8-b69b-4659-a201-524cba7752b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:20.451543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 172/337] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:20.481657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 166/338] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:20.766803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371a6e-4ae7-4d4b-ad7e-9daa6b950553 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:20.878447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371a6e-4ae7-4d4b-ad7e-9daa6b950553 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:20.917197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:20.926363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:20.927365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:20.927846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:20.928312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:20.929435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56a6c8-b69b-4659-a201-524cba7752b1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:20.943401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:20.948272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:20.949174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:20.950003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:20.958220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 173/339] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:20.959336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:20.961311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:21.088240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56a6c8-b69b-4659-a201-524cba7752b1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:21.119001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2223a-4730-40dd-b3d2-be7a334e7abd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:21.132258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786d5a6-9e73-437c-b828-90dbc4466fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:21.133289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786d5a6-9e73-437c-b828-90dbc4466fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.133764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786d5a6-9e73-437c-b828-90dbc4466fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.134296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786d5a6-9e73-437c-b828-90dbc4466fa3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.147563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786d5a6-9e73-437c-b828-90dbc4466fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-e786d5a6-9e73-437c-b828-90dbc4466fa3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:21.153017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:21.154376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:49:21.155152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:21.157959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 167/340] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:21.160784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a5981-4ce7-4569-929d-edad9bd7ec73 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.161513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a5981-4ce7-4569-929d-edad9bd7ec73 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.162194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a5981-4ce7-4569-929d-edad9bd7ec73 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.164334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 168/341] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:21.165392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a5981-4ce7-4569-929d-edad9bd7ec73 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:21.204041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86088f4-e6ef-4477-96c0-f4c065bfdd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:21.204687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86088f4-e6ef-4477-96c0-f4c065bfdd64 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.205068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86088f4-e6ef-4477-96c0-f4c065bfdd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.205348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86088f4-e6ef-4477-96c0-f4c065bfdd64 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.206112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86088f4-e6ef-4477-96c0-f4c065bfdd64 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:21.206425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86088f4-e6ef-4477-96c0-f4c065bfdd64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:21.208772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86088f4-e6ef-4477-96c0-f4c065bfdd64 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:21.228686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 174/342] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:21.230188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34695-0fb5-4443-b611-7b4c3802b88e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.230477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34695-0fb5-4443-b611-7b4c3802b88e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.230752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34695-0fb5-4443-b611-7b4c3802b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.248974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:21.266301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b2a34695-0fb5-4443-b611-7b4c3802b88e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:21.267986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2a34695-0fb5-4443-b611-7b4c3802b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:21.293930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a5981-4ce7-4569-929d-edad9bd7ec73 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:21.331928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:21.332763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.333165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.333586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.334380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:21.334857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:21.336514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:21.346447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 169/343] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:21.347459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:21.348364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:21.386535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 175/344] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:21.387580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34695-0fb5-4443-b611-7b4c3802b88e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:21.465269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25800d-24d2-4c9d-b90a-547ac290ecc9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:21.501275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:21.513567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:21.515469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.516110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.517968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.573402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34695-0fb5-4443-b611-7b4c3802b88e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:21.619662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:21.620747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.621224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.621764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] PATH_INFO: `/v3/users/fb2afdc3cf74428cb60099d161c84d07` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.625226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] RBAC: Authorizing `identity:get_user(user_id=fb2afdc3cf74428cb60099d161c84d07)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:21.627458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:21.629840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 176/345] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:49:21 2022] GET /identity/v3/users/fb2afdc3cf74428cb60099d161c84d07 => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:21.636285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:21.693862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:21.695399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:21.708430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:21.817054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3e08-5895-448c-84db-b894bc3842b8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:21.869065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:21.869792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:21.870008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:21.870288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:21.871075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] RBAC: Adding query filter params (role.id=9b29ff5da37348b084fb11e2a3e687eb, user.id=fb2afdc3cf74428cb60099d161c84d07, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:21.871393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:21.872989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:21.890451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 177/346] 10.222.0.89 () {56 vars in 1308 bytes} [Tue Aug 30 00:49:21 2022] GET /identity/v3/role_assignments?user.id=fb2afdc3cf74428cb60099d161c84d07&scope.system=all&role.id=9b29ff5da37348b084fb11e2a3e687eb => generated 510 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:21.904405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:21.906426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 170/347] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:21.913600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:21.983434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.035850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735459-0ac0-4a2f-b5e1-bcdbe865256a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:22.046353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.073932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017a6bf-4866-4eaf-a1f0-5c287c1abbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:22.074733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a6bf-4866-4eaf-a1f0-5c287c1abbae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.075207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a6bf-4866-4eaf-a1f0-5c287c1abbae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.075566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017a6bf-4866-4eaf-a1f0-5c287c1abbae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.087265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017a6bf-4866-4eaf-a1f0-5c287c1abbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f017a6bf-4866-4eaf-a1f0-5c287c1abbae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:22.095109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:22.096270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:22.097173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:22.097834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 178/348] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:22.099239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90881be7-3268-47cf-9aa7-058d9da348fa None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.099637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90881be7-3268-47cf-9aa7-058d9da348fa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.099979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90881be7-3268-47cf-9aa7-058d9da348fa None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.101378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 179/349] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:22.116781 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712d656-d3d2-4cbc-9e7a-a2fd25fe1101 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.117136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712d656-d3d2-4cbc-9e7a-a2fd25fe1101 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.117344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712d656-d3d2-4cbc-9e7a-a2fd25fe1101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.143352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3712d656-d3d2-4cbc-9e7a-a2fd25fe1101 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:22.144589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3712d656-d3d2-4cbc-9e7a-a2fd25fe1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:22.149454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212afdaf-4da7-4dfb-976b-48b2c50b548f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:22.210755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:22.211427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.211704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.211975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.213239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:22.214754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:22.216598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 171/350] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:21 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:22.218371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:22.232192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 180/351] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:22.233882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712d656-d3d2-4cbc-9e7a-a2fd25fe1101 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:22.339331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712d656-d3d2-4cbc-9e7a-a2fd25fe1101 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:22.368966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.370730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.372717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79287aa-ff55-4a61-921d-cbed4d0c1ce1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:22.381641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da297267-7d5e-4662-a5a0-9e42a53011c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:22.382280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297267-7d5e-4662-a5a0-9e42a53011c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.382566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297267-7d5e-4662-a5a0-9e42a53011c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.382835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297267-7d5e-4662-a5a0-9e42a53011c3 None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.389840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da297267-7d5e-4662-a5a0-9e42a53011c3 None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:22.391374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da297267-7d5e-4662-a5a0-9e42a53011c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:22.393482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 181/352] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:22 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:22.394605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b2f3-6de9-4532-b834-5bc10f0e9e86 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.394883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b2f3-6de9-4532-b834-5bc10f0e9e86 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.395162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b2f3-6de9-4532-b834-5bc10f0e9e86 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.396384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 182/353] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:22.403023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea3f0-645a-4376-b12e-919a13488214 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.403433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea3f0-645a-4376-b12e-919a13488214 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.403707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea3f0-645a-4376-b12e-919a13488214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.419808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:22.420441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.420734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.421204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.421986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:22.422391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:22.423472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fc5ea3f0-645a-4376-b12e-919a13488214 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:22.423949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:22.424699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc5ea3f0-645a-4376-b12e-919a13488214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:22.433390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 172/354] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:22.439008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:22.506657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 183/355] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:22.507628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea3f0-645a-4376-b12e-919a13488214 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:22.558259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafdb6-bed0-4457-aa8c-fffd1f0078e4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:22.597054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:22.598085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.598578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.599131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.600154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=febd778fccb344b5a7b41cd249190790) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:22.600655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:22.602445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:22.606459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.611253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 173/356] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:22 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:22.625043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea3f0-645a-4376-b12e-919a13488214 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:22.677974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:22.678507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.679090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.679356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.722051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:22.765567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:22.767055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:22.773238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.855491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae6c00-85b4-4ab5-bf58-dce1a7615c16 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:22.865705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.880847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 184/357] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:22.884993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:22.908225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:22.909080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:22.909467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:22.909831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:22.924658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:22.930145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:22.931097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:22.931859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 174/358] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:22.933088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:22.996433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88a45-2aff-465d-9367-b6fe2163aacc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.035469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.036533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.037031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.037485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.039564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.050716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:23.056121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:23.057109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:23.057882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:23.058496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814f26-ac45-43e2-a0cf-3a564f10d996 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.062140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 185/359] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:23.063234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:23.097298 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.098212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.098566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.098971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.100386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:23.102026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:23.104309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 175/360] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:22 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:23.108127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:23.125325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.177055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521dc8b-dcdf-4343-9109-254af5105ed4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.215926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.216983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.217591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.218048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.218964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:23.219539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:23.221247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:23.223373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bca21-442d-4b29-af8f-6dbbc52d16ef None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.230504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 186/361] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:23.231671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:23.267720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.268424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.268704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.269048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.269729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:23.270034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:23.271501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:23.281066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 176/362] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:23.281928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:23.302002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.352250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27b13-da14-4604-9ac1-8c110fbc37bf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.370674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.397937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.398592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.398838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.399112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.400241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:23.401745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:23.403626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 187/363] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:23 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:23.404424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:23.411920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45badbc-7d4b-4df8-8a86-2c0e137533a6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.457491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0cbc6-6c28-4ba9-82b6-e9e84adb1301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.458138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0cbc6-6c28-4ba9-82b6-e9e84adb1301 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.458417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0cbc6-6c28-4ba9-82b6-e9e84adb1301 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.458686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0cbc6-6c28-4ba9-82b6-e9e84adb1301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.527652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d6db4-899f-4cfe-877e-49a2355dda4f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.549569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0cbc6-6c28-4ba9-82b6-e9e84adb1301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:23.551021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0cbc6-6c28-4ba9-82b6-e9e84adb1301 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:23.570377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.577203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.577820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.578235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.578637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.649483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.671932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 177/364] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:23.672527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:23.673986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2bee2-a2a4-46e2-8c28-6e89819a6ea2 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.674188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:23.674681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2bee2-a2a4-46e2-8c28-6e89819a6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.675166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2bee2-a2a4-46e2-8c28-6e89819a6ea2 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.676980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 178/365] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:23.677888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2bee2-a2a4-46e2-8c28-6e89819a6ea2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:23.810988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 188/366] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:23.810988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:23.828960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2bee2-a2a4-46e2-8c28-6e89819a6ea2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:23.856879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.875527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5379451-8e92-4c93-b96d-cf741fcd8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:23.876216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379451-8e92-4c93-b96d-cf741fcd8007 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.876498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379451-8e92-4c93-b96d-cf741fcd8007 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.876772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379451-8e92-4c93-b96d-cf741fcd8007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.877530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5379451-8e92-4c93-b96d-cf741fcd8007 None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=febd778fccb344b5a7b41cd249190790) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:23.877834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5379451-8e92-4c93-b96d-cf741fcd8007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:23.879360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5379451-8e92-4c93-b96d-cf741fcd8007 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:23.886172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 179/367] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:23 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=407978df648d44abb9a8aafed3b0793f => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:23.887174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84a2fe-ca20-46d3-b600-b0c35426cb60 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:23.887480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84a2fe-ca20-46d3-b600-b0c35426cb60 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:23.887749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84a2fe-ca20-46d3-b600-b0c35426cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:23.911272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4e84a2fe-ca20-46d3-b600-b0c35426cb60 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:23.912496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4e84a2fe-ca20-46d3-b600-b0c35426cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:23.921919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:23.949150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcf49f-9fae-4c9f-9b66-3dd355a3eec8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.000312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.001454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.001935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.002427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.004332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 180/368] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:24.005713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84a2fe-ca20-46d3-b600-b0c35426cb60 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.006723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:24.008429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:24.010884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 189/369] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:23 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:24.020651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.143715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84a2fe-ca20-46d3-b600-b0c35426cb60 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.155262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18957a-44c6-44fe-86e5-63f16ac7f75c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.166350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:24.205565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.207085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.207643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.209114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.211440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:24.213651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:24.218212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 190/370] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:24.222426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.224231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.224904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.227744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.228895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.230484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:24.236372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:24.238906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 181/371] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:24.244147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.258925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:24.403918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddd006-4ce6-4b97-802f-0b93bfdc185f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.422978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33075e-a45f-4976-be69-5f59133a6ad9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.446899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.447936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.448410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.448891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.449899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:24.450409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:24.452105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:24.458749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 191/372] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:24.459960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.478475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.479527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.480020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.480484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.482075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:24.483772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:24.487402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 182/373] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:24.495333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.587507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:24.645196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:24.679778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b73ea8-588a-4d27-b99c-beb124ea8544 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.708517 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86c24-5ac4-48a3-b84c-5828124d796a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.753165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.753281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.753558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.753822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.774148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:24.780513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:24.781487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:24.782321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 192/374] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:24.785760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.786371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.786643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.786909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.787637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:24.787934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:24.789391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:24.792066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.799862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 183/375] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=407978df648d44abb9a8aafed3b0793f => generated 260 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:24.906577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83d0f6-c8e9-4d04-96a5-c3bbeb146c39 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:24.944723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebdd1d-fff9-4040-9c2b-5d3c1557af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:24.945279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebdd1d-fff9-4040-9c2b-5d3c1557af4e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.945549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebdd1d-fff9-4040-9c2b-5d3c1557af4e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.945815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebdd1d-fff9-4040-9c2b-5d3c1557af4e None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.946540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebdd1d-fff9-4040-9c2b-5d3c1557af4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:24.946836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebdd1d-fff9-4040-9c2b-5d3c1557af4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:24.948225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebdd1d-fff9-4040-9c2b-5d3c1557af4e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:24.957425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 193/376] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:24.963175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:24.970244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c6b9d-46b7-46e5-92df-e7f26ee77343 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.970561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c6b9d-46b7-46e5-92df-e7f26ee77343 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.970805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c6b9d-46b7-46e5-92df-e7f26ee77343 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.972606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 194/377] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:24.978274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8aea-2d6a-45ae-8dbd-643a38c4e973 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:24.978546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8aea-2d6a-45ae-8dbd-643a38c4e973 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:24.978819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8aea-2d6a-45ae-8dbd-643a38c4e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:24.991983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:25.013973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c65d8aea-2d6a-45ae-8dbd-643a38c4e973 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:25.015119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c65d8aea-2d6a-45ae-8dbd-643a38c4e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:25.130302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626c0f9-84b1-4171-88d6-7b83a71c483d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:25.133874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 195/378] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:25.143242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:25.169729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:25.170779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:25.171306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:25.171788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:25.245577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:25.247228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:25.366808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 184/379] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:25.373189 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d8aea-2d6a-45ae-8dbd-643a38c4e973 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:25.515098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d8aea-2d6a-45ae-8dbd-643a38c4e973 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:25.529776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:25.544333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:25.573575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:25.574575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:25.575428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:25.575966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] PATH_INFO: `/v3/projects/b2882d1c77544239bfa08e78d60c1fc1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:25.577312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] RBAC: Authorizing `identity:get_project(project_id=b2882d1c77544239bfa08e78d60c1fc1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:25.579825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:25.582677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 196/380] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:25 2022] GET /identity/v3/projects/b2882d1c77544239bfa08e78d60c1fc1 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:25.594459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:25.611686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:25.721505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df1617-67b9-4db1-b783-a962453961d8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:25.771672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6f19-4607-46be-ae44-55de94411d6b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:25.784413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:25.785568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:25.786065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:25.786548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:25.808624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:25.813635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:25.814549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:25.815326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:25.815925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 185/381] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:25.821575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:25.831584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:25.832226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:25.832498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:25.832769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] PATH_INFO: `/v3/groups/a3f76a10756042ec96bb1a1121b8f5cd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:25.845105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f76a10756042ec96bb1a1121b8f5cd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:25.846635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:25.848783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 197/382] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:25 2022] GET /identity/v3/groups/a3f76a10756042ec96bb1a1121b8f5cd => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:25.857033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:25.978740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:25.980876 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:26.039266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30cd45-c8b2-4e17-8cf0-85184ac76282 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:26.045483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d46bc-f03d-42d5-9dd9-7691359ec017 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:26.106505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:26.107006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:26.107277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:26.107544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:26.108321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] RBAC: Adding query filter params (group.id=a3f76a10756042ec96bb1a1121b8f5cd, role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=b2882d1c77544239bfa08e78d60c1fc1) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:26.108620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:26.110190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:26.117653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f58ec9-cdcb-4543-90a0-7d0d03446c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:26.118271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f58ec9-cdcb-4543-90a0-7d0d03446c80 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:26.118880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f58ec9-cdcb-4543-90a0-7d0d03446c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:26.119145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f58ec9-cdcb-4543-90a0-7d0d03446c80 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:26.119810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f58ec9-cdcb-4543-90a0-7d0d03446c80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:26.120106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f58ec9-cdcb-4543-90a0-7d0d03446c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:26.124839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 198/383] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:25 2022] GET /identity/v3/role_assignments?group.id=a3f76a10756042ec96bb1a1121b8f5cd&scope.project.id=b2882d1c77544239bfa08e78d60c1fc1&role.id=a456b12493c0413b825ef135c49a3338 => generated 260 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:26.125098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f58ec9-cdcb-4543-90a0-7d0d03446c80 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:26.142353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 186/384] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:26.148502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:26.297338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1c2ac-fa50-42da-9871-98d40677e9e4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:26.321375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508977-72c9-4edd-9b5d-ffd0d0a2f482 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:26.321832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508977-72c9-4edd-9b5d-ffd0d0a2f482 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:26.322230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508977-72c9-4edd-9b5d-ffd0d0a2f482 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:26.332611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 187/385] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:26.335257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c711a-677d-4268-b9a1-afe31cc072d7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:26.335536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c711a-677d-4268-b9a1-afe31cc072d7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:26.336036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c711a-677d-4268-b9a1-afe31cc072d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:26.346504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:26.358706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:26.359554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d84c711a-677d-4268-b9a1-afe31cc072d7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:26.359936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:26.360411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:26.360750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d84c711a-677d-4268-b9a1-afe31cc072d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:26.361255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:26.362760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:26.364580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:26.366534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 199/386] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:26 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:26.372868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:26.529390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 188/387] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:26.594387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d268050-1c96-4276-b0bf-9803b2765791 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:26.650418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:26.651451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:26.651951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:26.652425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:26.653882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:26.655581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:26.657502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 200/388] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:26 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:26.663537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c711a-677d-4268-b9a1-afe31cc072d7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:26.757443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:26.819197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c711a-677d-4268-b9a1-afe31cc072d7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:26.874266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:26.874864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:26.875136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:26.875401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790/groups/5627a22121f745ef9d36a4c9691d53ce/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:26.877321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=febd778fccb344b5a7b41cd249190790, group_id=5627a22121f745ef9d36a4c9691d53ce, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:26.878752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:26.898991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 189/389] 10.222.0.89 () {58 vars in 1442 bytes} [Tue Aug 30 00:49:26 2022] PUT /identity/v3/projects/febd778fccb344b5a7b41cd249190790/groups/5627a22121f745ef9d36a4c9691d53ce/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:26.997389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:27.089103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:27.142039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da67558-8e13-4d9c-aef1-b00a70994da4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:27.189252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ffc51-9514-40ce-88a3-11059a9a9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:27.189643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ffc51-9514-40ce-88a3-11059a9a9a8a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.190114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ffc51-9514-40ce-88a3-11059a9a9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.190386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ffc51-9514-40ce-88a3-11059a9a9a8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.207464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ffc51-9514-40ce-88a3-11059a9a9a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-645ffc51-9514-40ce-88a3-11059a9a9a8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:27.214025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:27.215004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:27.216397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:27.219377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 201/390] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:27.225161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:27.342189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e9500-e5bc-4ce1-9a67-7f9ad89060d5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:27.368328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:27.385822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:27.386915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.387481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.388006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.388927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:27.389440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:27.391044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:27.399277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc150-3c2f-428a-b93b-7b020a21f42b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.399538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc150-3c2f-428a-b93b-7b020a21f42b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.399750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc150-3c2f-428a-b93b-7b020a21f42b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.401475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 202/392] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:27.401716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 190/392] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:27.406733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:27.407206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417cc90-2db0-4778-8fd5-6d87e5b010f5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.407491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417cc90-2db0-4778-8fd5-6d87e5b010f5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.407766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417cc90-2db0-4778-8fd5-6d87e5b010f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.445889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9417cc90-2db0-4778-8fd5-6d87e5b010f5 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:27.447111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9417cc90-2db0-4778-8fd5-6d87e5b010f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:27.519095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714f7bf-1f92-449e-81fb-485c9e6cc353 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:27.557143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:27.558202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.558820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.559529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.561007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:27.562704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:27.564875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 191/393] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:27 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:27.573866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:27.634653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:27.635552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 203/394] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:27.695745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b817-1ec1-44f5-97fb-c1b988f783d3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:27.732727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f30b9-7ce5-4c42-94ad-b5fa21fe32a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:27.733392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f30b9-7ce5-4c42-94ad-b5fa21fe32a5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.733665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f30b9-7ce5-4c42-94ad-b5fa21fe32a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.733929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f30b9-7ce5-4c42-94ad-b5fa21fe32a5 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.735181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f30b9-7ce5-4c42-94ad-b5fa21fe32a5 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:27.736631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f30b9-7ce5-4c42-94ad-b5fa21fe32a5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:27.736857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee171-cbce-4940-b58c-8e4b6ac3d571 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.737170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee171-cbce-4940-b58c-8e4b6ac3d571 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.737441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee171-cbce-4940-b58c-8e4b6ac3d571 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.738496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 192/395] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:27 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:27.739031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 204/396] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:27.747907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e379-e36b-4951-aab3-fb455adee4a7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.747907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e379-e36b-4951-aab3-fb455adee4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.747907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9e379-e36b-4951-aab3-fb455adee4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.754173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee171-cbce-4940-b58c-8e4b6ac3d571 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:27.769817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ece9e379-e36b-4951-aab3-fb455adee4a7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:27.771781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ece9e379-e36b-4951-aab3-fb455adee4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:27.834776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:27.867648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 193/397] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:27.901302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee171-cbce-4940-b58c-8e4b6ac3d571 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:27.937298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:27.937976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:27.938299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:27.938574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790/groups/5627a22121f745ef9d36a4c9691d53ce/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:27.940742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=febd778fccb344b5a7b41cd249190790, group_id=5627a22121f745ef9d36a4c9691d53ce, role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:27.942246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:27.957961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 205/398] 10.222.0.89 () {58 vars in 1442 bytes} [Tue Aug 30 00:49:27 2022] PUT /identity/v3/projects/febd778fccb344b5a7b41cd249190790/groups/5627a22121f745ef9d36a4c9691d53ce/roles/407978df648d44abb9a8aafed3b0793f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:49:28.163704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9e379-e36b-4951-aab3-fb455adee4a7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:28.184459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:28.229361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:28.329572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9e379-e36b-4951-aab3-fb455adee4a7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:28.352908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ddd8-80a7-4703-9751-e14a7ee28cf6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:28.390733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:28.407924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:28.409084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.409614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.410110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.428418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:28.431802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.432309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.432766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.434581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:28.444879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:28.445798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:28.446621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:28.449376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 194/399] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:28.457166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:28.459013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:28.467611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:28.468528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:28.471675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:28.484974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 206/400] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:28.500773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:28.628443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e89a-44d6-4351-a914-ef082c5525f1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:28.643860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:28.690927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:28.691564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.691848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.692106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.692867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:28.693178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:28.694617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:28.713297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71c89-8f41-4362-8eb5-7a504de23a15 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:28.717051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 195/401] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:28.722741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:28.775266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed5005-f69b-4c52-bafc-90bfbe5cc6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:28.775891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed5005-f69b-4c52-bafc-90bfbe5cc6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.776171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed5005-f69b-4c52-bafc-90bfbe5cc6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.776435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed5005-f69b-4c52-bafc-90bfbe5cc6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.777142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed5005-f69b-4c52-bafc-90bfbe5cc6b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:28.777439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed5005-f69b-4c52-bafc-90bfbe5cc6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:28.778871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed5005-f69b-4c52-bafc-90bfbe5cc6b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:28.788481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 207/402] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:28.789803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6dde7-a321-4f29-b45e-1307ca75e501 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.790083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6dde7-a321-4f29-b45e-1307ca75e501 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.790351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6dde7-a321-4f29-b45e-1307ca75e501 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.791742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 208/403] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:28.796635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6dde7-a321-4f29-b45e-1307ca75e501 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:28.841745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:28.852322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f90930-04fe-4d09-943b-09c209afaa6c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:28.898246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a881-03d9-4f66-b28f-76db58a6b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:28.899044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a881-03d9-4f66-b28f-76db58a6b66b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.899325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a881-03d9-4f66-b28f-76db58a6b66b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.899603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a881-03d9-4f66-b28f-76db58a6b66b None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.901306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a881-03d9-4f66-b28f-76db58a6b66b None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:28.902966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a881-03d9-4f66-b28f-76db58a6b66b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:28.905774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 196/404] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:28 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:28.907585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56e71-9b85-4feb-bb2a-863b0bc00329 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.907869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56e71-9b85-4feb-bb2a-863b0bc00329 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.908143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56e71-9b85-4feb-bb2a-863b0bc00329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.910794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6dde7-a321-4f29-b45e-1307ca75e501 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:28.929991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-44a56e71-9b85-4feb-bb2a-863b0bc00329 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:28.931181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-44a56e71-9b85-4feb-bb2a-863b0bc00329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:28.947069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:28.948085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:28.948605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:28.949089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:28.950502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:28.952352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:28.954516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 209/405] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:28 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:28.955679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:28.971586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:29.020948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 197/406] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:29.020948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56e71-9b85-4feb-bb2a-863b0bc00329 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:29.110737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3327-7fce-4199-a5f4-473e0539e319 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:29.123521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:29.127658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56e71-9b85-4feb-bb2a-863b0bc00329 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:29.167591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:29.168244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.168550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.168838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.170093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:29.171719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:29.173777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 198/407] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:29 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:29.179744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:29.186685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:29.187916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.188435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.189045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.190405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:29.192305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:29.194653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 210/408] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:28 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:29.200907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:29.230731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:29.293251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b38e0-23fc-4e9b-a01d-8925289fa503 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:29.332499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:29.333451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.333734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.334006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/groups/5627a22121f745ef9d36a4c9691d53ce/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.337292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed0e0a7a14f34b2b98697929af5edbc5, group_id=5627a22121f745ef9d36a4c9691d53ce, role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:29.338756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:29.358489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 199/409] 10.222.0.89 () {58 vars in 1442 bytes} [Tue Aug 30 00:49:29 2022] PUT /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/groups/5627a22121f745ef9d36a4c9691d53ce/roles/407978df648d44abb9a8aafed3b0793f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:29.361195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:29.385467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3b12-48f8-400a-90f6-271456aef17e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:29.470212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3350bdc-4082-45b4-977d-5d0ed20b79b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:29.470938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350bdc-4082-45b4-977d-5d0ed20b79b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.471219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350bdc-4082-45b4-977d-5d0ed20b79b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.471495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350bdc-4082-45b4-977d-5d0ed20b79b6 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/groups/5627a22121f745ef9d36a4c9691d53ce/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.474286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3350bdc-4082-45b4-977d-5d0ed20b79b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed0e0a7a14f34b2b98697929af5edbc5, group_id=5627a22121f745ef9d36a4c9691d53ce, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:29.475772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3350bdc-4082-45b4-977d-5d0ed20b79b6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:29.500588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 211/410] 10.222.0.89 () {58 vars in 1442 bytes} [Tue Aug 30 00:49:29 2022] PUT /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5/groups/5627a22121f745ef9d36a4c9691d53ce/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:29.527768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:29.532540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e40ba-026c-4419-a8a4-c44e90b9b050 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:29.575220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:29.575994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.576279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.576554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.587483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0b4ca-970b-49f4-92e0-fc076b7bc187 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.587783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0b4ca-970b-49f4-92e0-fc076b7bc187 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.588027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0b4ca-970b-49f4-92e0-fc076b7bc187 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.589799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 212/411] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:29.591551 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:29.596736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:29.597756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:29.598558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 200/412] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:29.599983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b255-fad7-4dc5-8c66-f67a0054ed81 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.599983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b255-fad7-4dc5-8c66-f67a0054ed81 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.599983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b255-fad7-4dc5-8c66-f67a0054ed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.607886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:29.626669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a024b255-fad7-4dc5-8c66-f67a0054ed81 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:29.628264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a024b255-fad7-4dc5-8c66-f67a0054ed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:29.662618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:29.711266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 213/413] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:49:29.741510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2367bcf-1030-47c3-8674-217bcb638551 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:29.780218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:29.781273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.781863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.782335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.783229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:29.783727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:29.785374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:29.795330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 201/414] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:29.801419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024b255-fad7-4dc5-8c66-f67a0054ed81 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:29.908449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024b255-fad7-4dc5-8c66-f67a0054ed81 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:29.944534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:29.945568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:29.946065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:29.946530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] PATH_INFO: `/v3/groups/a3f76a10756042ec96bb1a1121b8f5cd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:29.947867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] RBAC: Authorizing `identity:get_group(group_id=a3f76a10756042ec96bb1a1121b8f5cd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:29.949590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:29.951696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 214/415] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:29 2022] GET /identity/v3/groups/a3f76a10756042ec96bb1a1121b8f5cd => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:29.957538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:29.981362 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:30.019532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:30.061193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:30.123335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614b4cb-3559-4795-bad9-3eccac897890 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:30.174935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31eee1-0727-4cee-8cae-82853aac1e9b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:30.187875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:30.189017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:30.189303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:30.189582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] PATH_INFO: `/v3/projects/b2882d1c77544239bfa08e78d60c1fc1` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:30.190722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] RBAC: Authorizing `identity:get_project(project_id=b2882d1c77544239bfa08e78d60c1fc1)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:30.192156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:30.194123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 202/416] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:29 2022] GET /identity/v3/projects/b2882d1c77544239bfa08e78d60c1fc1 => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:30.200279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:30.308223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfdae5-3c81-4ab3-a1a3-87fd54d8cef5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:30.313271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:30.313914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:30.314186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:30.314447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:30.322641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:30.345437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6e799-fb1b-4fb8-ad28-1510c6bf6e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:30.346122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6e799-fb1b-4fb8-ad28-1510c6bf6e40 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:30.346404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6e799-fb1b-4fb8-ad28-1510c6bf6e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:30.346682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6e799-fb1b-4fb8-ad28-1510c6bf6e40 None admin] PATH_INFO: `/v3/projects/b2882d1c77544239bfa08e78d60c1fc1/groups/a3f76a10756042ec96bb1a1121b8f5cd/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:30.347511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:30.352736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:30.353610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:30.354532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 215/417] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:30.359514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:30.359886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6e799-fb1b-4fb8-ad28-1510c6bf6e40 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2882d1c77544239bfa08e78d60c1fc1, group_id=a3f76a10756042ec96bb1a1121b8f5cd, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:30.361545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6e799-fb1b-4fb8-ad28-1510c6bf6e40 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:30.384865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 203/418] 10.222.0.89 () {58 vars in 1442 bytes} [Tue Aug 30 00:49:30 2022] PUT /identity/v3/projects/b2882d1c77544239bfa08e78d60c1fc1/groups/a3f76a10756042ec96bb1a1121b8f5cd/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:30.416232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3cb2-bee5-4812-8559-cd128c8b1cb1 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:30.416639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3cb2-bee5-4812-8559-cd128c8b1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:30.416952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3cb2-bee5-4812-8559-cd128c8b1cb1 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:30.418528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 204/419] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:30.430435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21bb68-1489-4c9c-8307-8c137af2537b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:30.430608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21bb68-1489-4c9c-8307-8c137af2537b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:30.430909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21bb68-1489-4c9c-8307-8c137af2537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:30.486013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4d21bb68-1489-4c9c-8307-8c137af2537b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:30.487230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4d21bb68-1489-4c9c-8307-8c137af2537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:30.497281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:30.504872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68832-7c75-4586-b8ae-6af891ae9bc1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:30.546840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:30.547849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:30.548371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:30.548890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:30.549813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:30.550804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:30.552534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:30.564071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 216/420] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:30.569717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:30.641015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 205/421] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:30.742098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390c086-7026-4393-9279-fbdcfce64068 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:30.791446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:30.792294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:30.792734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:30.793173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:30.826563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:30.883866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:30.885620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:31.019683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 217/422] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:31.025386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21bb68-1489-4c9c-8307-8c137af2537b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:31.104487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:31.135159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21bb68-1489-4c9c-8307-8c137af2537b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:31.151177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:31.216100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:31.216880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.217162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.217434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.224147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:31.225654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:31.230228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 206/423] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:31 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:31.233826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:31.246442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:31.337313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501436a0-5ff7-47f7-940f-04dcae60eb3e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:31.376638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:31.377309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.377582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.377848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.398655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:31.403650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:31.404579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:31.405842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 218/424] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:31.410752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:31.445406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff6cba-d7c4-428e-843c-2b3868f5b7d3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:31.509363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:31.510002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.510286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.510556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.512594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:31.514842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:31.519025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 207/425] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:31 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:31.527066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:31.556950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:31.588888 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f609-95ae-41b2-9f50-9d2afce36923 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:31.612165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:31.650995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:31.651682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.651967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.652226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.654213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:31.654528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:31.656195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:31.672873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 219/426] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:31.678617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:31.712831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d81de4-3464-4ae4-b756-8c262075bede None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:31.751792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98ee73-5dff-4653-bbc5-02928152c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:31.752416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ee73-5dff-4653-bbc5-02928152c8ef None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.753279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ee73-5dff-4653-bbc5-02928152c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.753279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ee73-5dff-4653-bbc5-02928152c8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.754009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98ee73-5dff-4653-bbc5-02928152c8ef None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=febd778fccb344b5a7b41cd249190790) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:31.754317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98ee73-5dff-4653-bbc5-02928152c8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:31.756588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98ee73-5dff-4653-bbc5-02928152c8ef None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:31.768337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 208/427] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:31 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 611 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:31.771270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896550a-9a65-437a-993c-d8786db7ea6b None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.771549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896550a-9a65-437a-993c-d8786db7ea6b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.772015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896550a-9a65-437a-993c-d8786db7ea6b None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.778781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 209/428] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:31.778781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b560-7a92-4d06-9a6c-1e0ec455563a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.778781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b560-7a92-4d06-9a6c-1e0ec455563a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.778781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b560-7a92-4d06-9a6c-1e0ec455563a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.778781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 210/429] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:31.781022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a25f-7031-4bd2-a126-e3f73dcab2bd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.781406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a25f-7031-4bd2-a126-e3f73dcab2bd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.782824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a25f-7031-4bd2-a126-e3f73dcab2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.809790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8c78a25f-7031-4bd2-a126-e3f73dcab2bd None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:31.811476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8c78a25f-7031-4bd2-a126-e3f73dcab2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:31.818221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49161e9-16ff-4b17-a763-c3397f6a9e9f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:31.858777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:31.860173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.860629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.861166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.913994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:31.920074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 211/430] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:31.928938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76631a-2090-4d12-89bd-ff56dbc385fe None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:31.928938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76631a-2090-4d12-89bd-ff56dbc385fe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:31.928938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76631a-2090-4d12-89bd-ff56dbc385fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:31.945414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:31.945599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5e76631a-2090-4d12-89bd-ff56dbc385fe None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:31.946774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5e76631a-2090-4d12-89bd-ff56dbc385fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:31.946974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:31.949062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:32.023708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 212/431] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:32.066601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 220/432] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:32.073141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76631a-2090-4d12-89bd-ff56dbc385fe None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.193023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76631a-2090-4d12-89bd-ff56dbc385fe None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.212654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.240939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.241588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.241867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.242490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] PATH_INFO: `/v3/projects/febd778fccb344b5a7b41cd249190790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.244201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] RBAC: Authorizing `identity:get_project(project_id=febd778fccb344b5a7b41cd249190790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:32.246128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:32.248833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 213/433] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/projects/febd778fccb344b5a7b41cd249190790 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:32.257867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.275836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:32.304725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:32.332197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c5e02-831c-426d-a1dd-c46d8b9013a0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.380565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.381144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.381425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.381698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.389548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987ec4-327b-49e8-8ec3-676e617c210c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.398002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:32.404307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:32.405453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 221/434] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:32.406605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.444784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.445401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.445679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.445950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.447535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:32.449019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:32.455537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 214/435] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:32.455537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.542638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd455f1-8fc7-4407-8a59-2da97378ae89 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.547950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:32.575312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a366d-caf6-40ab-9695-1bdb28cb0366 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.578542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.579192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.579473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.579742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.582842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:32.592115 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:32.597408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:32.598325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:32.599166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 222/436] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:32.599854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.620392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.621243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.621654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.621960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.622647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:32.622946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:32.624557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:32.633359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 215/437] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:32.634194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.711020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bca0e-7e6a-4837-b911-a30a65f7983c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.736965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e90a-4a48-49fb-80a6-77fa1e344163 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.745197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.745820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.746098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.746408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.747177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=febd778fccb344b5a7b41cd249190790) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:32.747483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:32.749173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:32.755061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 223/438] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=febd778fccb344b5a7b41cd249190790&role.id=407978df648d44abb9a8aafed3b0793f => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:32.755886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.774781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a307f49-6ce5-4199-ac2d-960173b63fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.775410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307f49-6ce5-4199-ac2d-960173b63fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.775681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307f49-6ce5-4199-ac2d-960173b63fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.775945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307f49-6ce5-4199-ac2d-960173b63fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.776946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307f49-6ce5-4199-ac2d-960173b63fa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:32.777247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307f49-6ce5-4199-ac2d-960173b63fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:32.778729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307f49-6ce5-4199-ac2d-960173b63fa8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:32.781958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:32.790834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 216/439] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:32.791994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1996a-43d6-4441-9cd3-a52a09463868 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.792288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1996a-43d6-4441-9cd3-a52a09463868 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.792538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1996a-43d6-4441-9cd3-a52a09463868 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.794081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 217/440] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:32.798392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1996a-43d6-4441-9cd3-a52a09463868 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:32.847231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:32.896854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266225f-4b32-46dc-b0a5-afb5e5151787 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.918748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1996a-43d6-4441-9cd3-a52a09463868 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:32.939467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c00696-aa7a-4d35-b1a7-543f6ac1b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.940072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00696-aa7a-4d35-b1a7-543f6ac1b64f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.940350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00696-aa7a-4d35-b1a7-543f6ac1b64f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.940705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00696-aa7a-4d35-b1a7-543f6ac1b64f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:32.963186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:32.964044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:32.964319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:32.964568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.020167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c00696-aa7a-4d35-b1a7-543f6ac1b64f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.020649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c00696-aa7a-4d35-b1a7-543f6ac1b64f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.053398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.057845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.060081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.093205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.139721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 224/441] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:33.140955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598261-1de7-4939-96ea-096e4f8882e0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.141234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598261-1de7-4939-96ea-096e4f8882e0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.141498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598261-1de7-4939-96ea-096e4f8882e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.159211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-27598261-1de7-4939-96ea-096e4f8882e0 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:33.160398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27598261-1de7-4939-96ea-096e4f8882e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:33.170635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 218/442] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:33.171468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.228995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 225/443] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:33.229772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27598261-1de7-4939-96ea-096e4f8882e0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.285543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.289674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe6c90-8ba4-4cbc-b078-54d721c1ac2f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.324564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.325852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.326714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.327136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.327574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.328719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.330172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.331797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 219/444] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:33.335794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27598261-1de7-4939-96ea-096e4f8882e0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.337756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.374095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.374717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.374990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.375255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] PATH_INFO: `/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.376346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] RBAC: Authorizing `identity:get_project(project_id=ed0e0a7a14f34b2b98697929af5edbc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.377944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.379618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 226/445] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/projects/ed0e0a7a14f34b2b98697929af5edbc5 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:33.385238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.443385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d25e9-2698-4098-8ae2-98294af12826 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.478337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.478974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.479306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.479518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.480612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.482149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.483726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 220/446] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:33.489386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.497663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347e2e-bfb1-4adc-96df-e1e2ec256b27 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.523808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.533527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.534158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.534426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.534687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] PATH_INFO: `/v3/groups/5627a22121f745ef9d36a4c9691d53ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.535872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] RBAC: Authorizing `identity:get_group(group_id=5627a22121f745ef9d36a4c9691d53ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.537377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.539065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 227/447] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/groups/5627a22121f745ef9d36a4c9691d53ce => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:33.544570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.567966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.597227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1406e-07f6-4a7c-8eac-9d2a4d7fc25c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.631037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.631648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.631927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.632185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.632957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:33.633263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.634712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.640431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e69dfc-d869-44f8-a29e-242373efae8f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.640554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 221/448] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=407978df648d44abb9a8aafed3b0793f => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:33.641305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.678439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.679073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.679343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.679610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.691593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:33.696565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:33.697684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:33.698508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 228/449] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:33.703976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.763846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.769306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1185afa-60b8-401f-a69e-425724c846c8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.804403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:33.816215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.816912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.817195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.817467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.818214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] RBAC: Adding query filter params (group.id=5627a22121f745ef9d36a4c9691d53ce, role.id=ed49631efea14b8fbf4b884c491e4092, scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:33.818523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.819956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.826396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 222/450] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/role_assignments?group.id=5627a22121f745ef9d36a4c9691d53ce&scope.project.id=ed0e0a7a14f34b2b98697929af5edbc5&role.id=ed49631efea14b8fbf4b884c491e4092 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:33.827559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c7561-f336-4016-8d56-b7a3372db387 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:33.867822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:33.868760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:33.869068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:33.869334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:33.870014 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:33.870311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:33.871776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:33.881302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 229/451] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:33.887772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:33.996520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10be9d-e82d-4d82-9d36-7adfaed22f3e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:34.031229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:34.031760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:34.032034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:34.032299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:34.067864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:34.108405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:34.110009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:34.215121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 223/452] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:34.221835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:34.326189 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13129677-1f10-4e5b-9d1e-b8d6e1792f27 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:34.360512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:34.361204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:34.361471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:34.361734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] PATH_INFO: `/v3/projects/b2882d1c77544239bfa08e78d60c1fc1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:34.362922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=b2882d1c77544239bfa08e78d60c1fc1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:34.364430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:34.366121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 230/453] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:49:34 2022] GET /identity/v3/projects/b2882d1c77544239bfa08e78d60c1fc1 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:34.372884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:34.435175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:34.474619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133290-d643-4cb2-9e5d-68eb462719bd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:34.511330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfcad-0ba0-4f9c-8f6e-d2c43e98a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:34.511992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfcad-0ba0-4f9c-8f6e-d2c43e98a909 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:34.512294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfcad-0ba0-4f9c-8f6e-d2c43e98a909 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:34.512578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfcad-0ba0-4f9c-8f6e-d2c43e98a909 None admin] PATH_INFO: `/v3/groups/a3f76a10756042ec96bb1a1121b8f5cd` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:34.513806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfcad-0ba0-4f9c-8f6e-d2c43e98a909 None admin] RBAC: Authorizing `identity:get_group(group_id=a3f76a10756042ec96bb1a1121b8f5cd)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:34.515252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfcad-0ba0-4f9c-8f6e-d2c43e98a909 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:34.516874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 224/454] 10.222.0.89 () {56 vars in 1180 bytes} [Tue Aug 30 00:49:34 2022] GET /identity/v3/groups/a3f76a10756042ec96bb1a1121b8f5cd => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:34.523129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:34.543898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:34.629948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b1bd4-39a8-47b6-8ece-3f1072b43dc9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:34.664450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c8ded-4f9b-43ce-ac2b-d1bd4f33473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:34.665059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c8ded-4f9b-43ce-ac2b-d1bd4f33473c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:34.665328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c8ded-4f9b-43ce-ac2b-d1bd4f33473c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:34.665594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c8ded-4f9b-43ce-ac2b-d1bd4f33473c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:34.666329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c8ded-4f9b-43ce-ac2b-d1bd4f33473c None admin] RBAC: Adding query filter params (group.id=a3f76a10756042ec96bb1a1121b8f5cd, role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=b2882d1c77544239bfa08e78d60c1fc1) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:34.666627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c8ded-4f9b-43ce-ac2b-d1bd4f33473c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:34.668059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c8ded-4f9b-43ce-ac2b-d1bd4f33473c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:34.674103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 231/455] 10.222.0.89 () {56 vars in 1376 bytes} [Tue Aug 30 00:49:34 2022] GET /identity/v3/role_assignments?group.id=a3f76a10756042ec96bb1a1121b8f5cd&scope.project.id=b2882d1c77544239bfa08e78d60c1fc1&role.id=a456b12493c0413b825ef135c49a3338 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:36.984910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fcf6b-29d3-41e0-a615-28b84ba8948d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:36.985930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fcf6b-29d3-41e0-a615-28b84ba8948d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:36.986398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fcf6b-29d3-41e0-a615-28b84ba8948d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:36.987937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 225/456] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:37.006993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdf06-35d6-49fd-b88b-ef794a64f08a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.007466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdf06-35d6-49fd-b88b-ef794a64f08a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.007466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdf06-35d6-49fd-b88b-ef794a64f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.034087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-03dfdf06-35d6-49fd-b88b-ef794a64f08a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:37.035317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-03dfdf06-35d6-49fd-b88b-ef794a64f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:37.121764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 232/457] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:37.200525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a16b6-79f6-4c3d-b19d-687d15e00a05 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.201224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a16b6-79f6-4c3d-b19d-687d15e00a05 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.201714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a16b6-79f6-4c3d-b19d-687d15e00a05 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.203532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 226/458] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:37.209140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d007ffe-c8bc-4d17-a13c-2acf9f3fb5f1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.209708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d007ffe-c8bc-4d17-a13c-2acf9f3fb5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.210180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d007ffe-c8bc-4d17-a13c-2acf9f3fb5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.234007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6d007ffe-c8bc-4d17-a13c-2acf9f3fb5f1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:37.235614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6d007ffe-c8bc-4d17-a13c-2acf9f3fb5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:37.239011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:37.319887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 233/459] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:37.491935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a16b6-79f6-4c3d-b19d-687d15e00a05 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:37.517985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3cb4-0ffe-48a2-a750-380fd7617d67 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.518306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3cb4-0ffe-48a2-a750-380fd7617d67 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.518532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3cb4-0ffe-48a2-a750-380fd7617d67 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.520286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 234/460] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:37.528579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05811126-187b-47c7-98e0-fece8abc880a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.528900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05811126-187b-47c7-98e0-fece8abc880a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.529177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05811126-187b-47c7-98e0-fece8abc880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.566362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-05811126-187b-47c7-98e0-fece8abc880a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:37.567576 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-05811126-187b-47c7-98e0-fece8abc880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:37.680538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a16b6-79f6-4c3d-b19d-687d15e00a05 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:37.711799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 235/461] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:37.712665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05811126-187b-47c7-98e0-fece8abc880a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:37.726830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:37.739104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:37.739762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.740033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.740301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.761382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:37.764152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:37.793574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:37.794539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:37.795405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:37.795405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:37.795405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:37.798939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 227/462] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:37.807639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:37.849903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:37.896531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05811126-187b-47c7-98e0-fece8abc880a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:37.932861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c9299-c31c-4247-80b8-3b735643fc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:37.933747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9299-c31c-4247-80b8-3b735643fc84 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.934178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94e2d0-0059-4709-9707-74c2b75e3a3d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:37.934328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9299-c31c-4247-80b8-3b735643fc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.934714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9299-c31c-4247-80b8-3b735643fc84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.946692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c9299-c31c-4247-80b8-3b735643fc84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:37.948381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c9299-c31c-4247-80b8-3b735643fc84 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-111c9299-c31c-4247-80b8-3b735643fc84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:37.966526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:37.967833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:37.968664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:37.968664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:37.968664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:37.970380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 236/463] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:37.971849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa559-74da-46ef-9464-a98a52d538e5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.972341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa559-74da-46ef-9464-a98a52d538e5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.972952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa559-74da-46ef-9464-a98a52d538e5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.978492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 237/464] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:37.978492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa559-74da-46ef-9464-a98a52d538e5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:37.983671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f547b-72c7-4383-ae08-756d441e84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:37.984299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f547b-72c7-4383-ae08-756d441e84cf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:37.984576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f547b-72c7-4383-ae08-756d441e84cf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:37.984892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f547b-72c7-4383-ae08-756d441e84cf None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:37.985552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f547b-72c7-4383-ae08-756d441e84cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:37.986125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f547b-72c7-4383-ae08-756d441e84cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:37.987281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f547b-72c7-4383-ae08-756d441e84cf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.006624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 228/465] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:38.007976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb73e-846b-4aaf-acad-eb35634bdd5e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.008262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb73e-846b-4aaf-acad-eb35634bdd5e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.008530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbb73e-846b-4aaf-acad-eb35634bdd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.027830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-73dbb73e-846b-4aaf-acad-eb35634bdd5e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:38.029484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-73dbb73e-846b-4aaf-acad-eb35634bdd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:38.067367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:38.090467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa559-74da-46ef-9464-a98a52d538e5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.105004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 229/466] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:38.105004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbb73e-846b-4aaf-acad-eb35634bdd5e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:38.115660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:38.128744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.129583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.130075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.130477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.131280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:38.131708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.133259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.146577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 238/467] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:38.147689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:38.251207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbb73e-846b-4aaf-acad-eb35634bdd5e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.263188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51650e94-9aff-47db-b2d4-6c564fea8100 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.296842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.297470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.297751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.298020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.298668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.300114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.300556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.301366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.301774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.302176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.313917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.315532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.327899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 230/468] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:38 2022] POST /identity/v3/users => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:38.329074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:38.331741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:38.332726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:38.333627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:38.333627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:38.333627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:38.333627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 239/469] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:38.349261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:38.402281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:38.404945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:38.508350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d763f-226b-4c7b-a6ef-74af0f73a3b2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.515316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed709220-c900-4588-ad82-aef16622b3d9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.552505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.553173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.553450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.553715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.554378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:38.554740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.556044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.556166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.557145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.557627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.558053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.559075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.560665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.570118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 240/470] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:38.572116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:38.583978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 231/471] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:38 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:38.585050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:38.693015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:38.701092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258735b-fed4-4453-8689-6791ef83d275 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.706452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:38.726453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84006e-0f24-493c-af70-d8b56765103d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.747027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48652872-a9ea-44ce-bd12-4c4a2d5bc601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.747942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652872-a9ea-44ce-bd12-4c4a2d5bc601 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.748355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652872-a9ea-44ce-bd12-4c4a2d5bc601 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.748761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652872-a9ea-44ce-bd12-4c4a2d5bc601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.761354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48652872-a9ea-44ce-bd12-4c4a2d5bc601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.763220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48652872-a9ea-44ce-bd12-4c4a2d5bc601 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.777677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ca08b-b035-4dc6-a544-688b1c85a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.778409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca08b-b035-4dc6-a544-688b1c85a9a7 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.778613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca08b-b035-4dc6-a544-688b1c85a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.778858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca08b-b035-4dc6-a544-688b1c85a9a7 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.779520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ca08b-b035-4dc6-a544-688b1c85a9a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.783892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ca08b-b035-4dc6-a544-688b1c85a9a7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-48652872-a9ea-44ce-bd12-4c4a2d5bc601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:38.784010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:38.784890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:38.785760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:38.785760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:38.785760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:38.785760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 241/472] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:38.785760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6d0d-a5e4-4f7c-be65-5e626b37c2d7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.785760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6d0d-a5e4-4f7c-be65-5e626b37c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.785760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6d0d-a5e4-4f7c-be65-5e626b37c2d7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.786129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 242/473] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:38.789802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6d0d-a5e4-4f7c-be65-5e626b37c2d7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:38.808848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 232/474] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:38 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:38.810948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2191c-c0e7-4a5f-9f08-f807bd53567d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.810948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2191c-c0e7-4a5f-9f08-f807bd53567d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.811150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2191c-c0e7-4a5f-9f08-f807bd53567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.834146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ecd2191c-c0e7-4a5f-9f08-f807bd53567d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:38.835428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ecd2191c-c0e7-4a5f-9f08-f807bd53567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:38.929629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 233/475] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:38.938281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6d0d-a5e4-4f7c-be65-5e626b37c2d7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:38.981462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:38.981462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:38.981728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:38.981795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:38.982426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:38.982720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:38.984090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:38.998327 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 243/476] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:39.003834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2191c-c0e7-4a5f-9f08-f807bd53567d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:39.087872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:39.120096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2191c-c0e7-4a5f-9f08-f807bd53567d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:39.155375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:39.155990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:39.156272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:39.156536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:39.157227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:39.158709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:39.189007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 234/477] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:39 2022] POST /identity/v3/users => generated 249 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:39.223372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:39.242247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:39.395053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49943-df45-49d9-ae3e-44caabd2d2b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:39.432595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:39.433232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:39.433507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:39.433808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:39.434486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:39.435879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:39.445459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:49:39.445459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:49:39.445459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [parameters: {'id': '6ba3934053de4ffe83df3a4ebcfa2046', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:49:39.445459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Aug 30 00:49:39.462061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:49:39.462953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:49:39.463847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:49:39.464696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:49:39.465759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:49:39.466611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'id': '6ba3934053de4ffe83df3a4ebcfa2046', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:39.467466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:49:39.468245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:39.469158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 244/478] 10.222.0.89 () {60 vars in 1131 bytes} [Tue Aug 30 00:49:39 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:39.474240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:39.609107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c649-7d57-4529-abd4-87ba125a6013 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:39.639496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:39.649121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38215e5-0f9c-4126-9a69-adda3b926bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:39.650088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215e5-0f9c-4126-9a69-adda3b926bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:39.650560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215e5-0f9c-4126-9a69-adda3b926bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:39.651087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38215e5-0f9c-4126-9a69-adda3b926bd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:39.669779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38215e5-0f9c-4126-9a69-adda3b926bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d38215e5-0f9c-4126-9a69-adda3b926bd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:39.675274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:39.676158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:39.676996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 235/479] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:39.685913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:39.824919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:39.867545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57309bd4-8275-49e9-9e22-d697dfbaeec4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:39.912915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf52c-df29-442b-b3f0-836371cffe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:39.913443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf52c-df29-442b-b3f0-836371cffe59 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:39.913716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf52c-df29-442b-b3f0-836371cffe59 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:39.913984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf52c-df29-442b-b3f0-836371cffe59 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:39.914653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf52c-df29-442b-b3f0-836371cffe59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:39.914950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf52c-df29-442b-b3f0-836371cffe59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:39.916318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf52c-df29-442b-b3f0-836371cffe59 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:39.928172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 245/480] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:40.739539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278dfcc-0be1-4413-aea0-807d039682a4 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:40.740055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278dfcc-0be1-4413-aea0-807d039682a4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:40.740055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278dfcc-0be1-4413-aea0-807d039682a4 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:40.741737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 236/481] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:40.749450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6a659-1367-4746-8160-02bc7e757f58 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:40.749906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6a659-1367-4746-8160-02bc7e757f58 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:40.749979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6a659-1367-4746-8160-02bc7e757f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:40.783080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-99e6a659-1367-4746-8160-02bc7e757f58 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:40.784316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99e6a659-1367-4746-8160-02bc7e757f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:40.881458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 246/482] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:41.115606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af5f1-e4ca-407f-a021-eb99284367b6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.115947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af5f1-e4ca-407f-a021-eb99284367b6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.116063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af5f1-e4ca-407f-a021-eb99284367b6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.117428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 237/483] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:41.123132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9d8f-8b9c-4fd0-a9dc-14bb8408b285 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.123416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9d8f-8b9c-4fd0-a9dc-14bb8408b285 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.123692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9d8f-8b9c-4fd0-a9dc-14bb8408b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.145780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e73f9d8f-8b9c-4fd0-a9dc-14bb8408b285 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:41.146973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e73f9d8f-8b9c-4fd0-a9dc-14bb8408b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:41.188244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af5f1-e4ca-407f-a021-eb99284367b6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:41.236752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:41.253365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 247/484] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:41.254637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe1e4-03c2-407e-9b47-6189dc2ee302 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.254919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe1e4-03c2-407e-9b47-6189dc2ee302 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.255191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe1e4-03c2-407e-9b47-6189dc2ee302 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.256572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 248/485] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:41.262199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980528b-1370-4439-8e29-c68ed95680bd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.262513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980528b-1370-4439-8e29-c68ed95680bd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.262823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980528b-1370-4439-8e29-c68ed95680bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.284477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3980528b-1370-4439-8e29-c68ed95680bd None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:41.285702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3980528b-1370-4439-8e29-c68ed95680bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:41.366983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af5f1-e4ca-407f-a021-eb99284367b6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:41.412491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 249/486] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:41.428279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:41.428950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.429225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.429491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.446125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:41.451070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:41.451930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:41.452712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 238/487] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:41.458213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980528b-1370-4439-8e29-c68ed95680bd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:41.574667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:41.590462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980528b-1370-4439-8e29-c68ed95680bd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:41.640601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:41.654813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:41.662767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:41.663597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.663706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.663904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.664581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:41.664899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:41.666297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:41.683690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 250/488] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:41.687496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:41.751267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6c87-ee62-418c-a351-b39b23c8dc1a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:41.798820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:41.799465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.799792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.800070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.811732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:41.816971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:41.817848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:41.818724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 239/489] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:41.819762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:41.834774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084ddd-4cb0-4d53-a6e6-cbc833911081 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:41.873846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96ec00-28b7-4f5f-9974-eee0eb1b289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:41.874474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ec00-28b7-4f5f-9974-eee0eb1b289d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.874751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ec00-28b7-4f5f-9974-eee0eb1b289d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.875019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ec00-28b7-4f5f-9974-eee0eb1b289d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.885827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96ec00-28b7-4f5f-9974-eee0eb1b289d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:41.887380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96ec00-28b7-4f5f-9974-eee0eb1b289d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ba96ec00-28b7-4f5f-9974-eee0eb1b289d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:41.901914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:41.902982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:41.903847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:41.903847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:41.903847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:41.903847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 251/490] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:41.904871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b7b6-ccde-4d7f-b384-d869d088049b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.904871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b7b6-ccde-4d7f-b384-d869d088049b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.904871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b7b6-ccde-4d7f-b384-d869d088049b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.910267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 252/491] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:41.910267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b7b6-ccde-4d7f-b384-d869d088049b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:41.939818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e5c3e-35cb-400a-8874-bfa97005784f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:41.947780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:41.952260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:41.978499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576845f-74db-4878-b938-12624635ba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:41.979160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576845f-74db-4878-b938-12624635ba06 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:41.979439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576845f-74db-4878-b938-12624635ba06 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:41.980169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576845f-74db-4878-b938-12624635ba06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:41.990807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576845f-74db-4878-b938-12624635ba06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d576845f-74db-4878-b938-12624635ba06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:41.996351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:41.997262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:41.998075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:42.000048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 240/492] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:42.000622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576845f-74db-4878-b938-12624635ba06 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.038574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b7b6-ccde-4d7f-b384-d869d088049b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.074204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369559b-1dd8-4683-9d00-b58c503d511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.074882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369559b-1dd8-4683-9d00-b58c503d511b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.075158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369559b-1dd8-4683-9d00-b58c503d511b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.075425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369559b-1dd8-4683-9d00-b58c503d511b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.076091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369559b-1dd8-4683-9d00-b58c503d511b None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:42.076379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369559b-1dd8-4683-9d00-b58c503d511b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.077791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369559b-1dd8-4683-9d00-b58c503d511b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.085862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 253/493] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:42.087109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f67751-6a35-4ee8-af0b-c0c387a9eaa9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.087391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f67751-6a35-4ee8-af0b-c0c387a9eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.087662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f67751-6a35-4ee8-af0b-c0c387a9eaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.108972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b7f67751-6a35-4ee8-af0b-c0c387a9eaa9 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:42.110173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7f67751-6a35-4ee8-af0b-c0c387a9eaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:42.114531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576845f-74db-4878-b938-12624635ba06 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.150957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.151558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.151834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.152160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.152843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:42.153147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.154717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.167468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 241/494] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:42.168626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.193590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 254/495] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:42.194866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f67751-6a35-4ee8-af0b-c0c387a9eaa9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.200406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.241112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.299026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20c28a-95f3-426e-b77d-1e9fb9861606 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.337086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f67751-6a35-4ee8-af0b-c0c387a9eaa9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.344379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.345227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.345763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.346169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.346968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:42.347402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.349139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.364080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 242/496] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:42.365214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.377062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.377703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.377981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.378255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.392235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.394065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:42.414916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:42.415990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:42.416896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:42.416896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:42.416896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:42.416896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 255/497] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:42.416896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.470129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.483225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e81a3-70bc-4f83-8713-2093270f23aa None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.504900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.517675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.518310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.518626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.518878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.525839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c651-4673-4c22-9ebc-3b28320a5156 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.526572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.528436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:42.541333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:42.542307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 243/498] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:42.543342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.567054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33bc6a-089f-4da9-90f6-e2513c241f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.567672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33bc6a-089f-4da9-90f6-e2513c241f03 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.567941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33bc6a-089f-4da9-90f6-e2513c241f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.568203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33bc6a-089f-4da9-90f6-e2513c241f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.579419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33bc6a-089f-4da9-90f6-e2513c241f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.580900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33bc6a-089f-4da9-90f6-e2513c241f03 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7d33bc6a-089f-4da9-90f6-e2513c241f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:42.595356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:42.596265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:42.597160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:42.597160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:42.597160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:42.597160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 256/499] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:42.597568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc8df-d3ca-41bb-bc77-4ceaef736dcf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.597816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc8df-d3ca-41bb-bc77-4ceaef736dcf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.598112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc8df-d3ca-41bb-bc77-4ceaef736dcf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.599283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 257/500] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:42.599953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc8df-d3ca-41bb-bc77-4ceaef736dcf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.657826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f6f9-6488-424e-9fb1-14a995dbeab4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.692535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.693101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.693394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.693651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.694292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:42.694590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.695971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.703842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc8df-d3ca-41bb-bc77-4ceaef736dcf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.708659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 244/501] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:42.709297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.720100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.737513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.743050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.743986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.744254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.744518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.760837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:42.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:42.766976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 258/502] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:42.768367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.814103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce594a1-702f-4bf5-95e6-84cb9c5d83da None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.849916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09c829-ab35-431c-8c1a-a8b8237d9eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.850527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c829-ab35-431c-8c1a-a8b8237d9eca None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.850784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c829-ab35-431c-8c1a-a8b8237d9eca None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.851055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c829-ab35-431c-8c1a-a8b8237d9eca None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.851786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09c829-ab35-431c-8c1a-a8b8237d9eca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:42.852089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09c829-ab35-431c-8c1a-a8b8237d9eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.853556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09c829-ab35-431c-8c1a-a8b8237d9eca None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.870293 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e5531-3a85-4671-a77a-1748f6b4f7e3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:42.891173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 245/503] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:42.892477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134e29-a2e2-43eb-a5af-20d183fd96ff None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.892766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134e29-a2e2-43eb-a5af-20d183fd96ff None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.893046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134e29-a2e2-43eb-a5af-20d183fd96ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.905160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:42.905772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:42.906047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:42.906317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:42.906964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:42.907309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:42.908649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:42.911409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f2134e29-a2e2-43eb-a5af-20d183fd96ff None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:42.912606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f2134e29-a2e2-43eb-a5af-20d183fd96ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:42.921151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 259/504] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:42.921959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:42.969545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.975823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:42.978551 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 246/505] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:42.979183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134e29-a2e2-43eb-a5af-20d183fd96ff None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.026286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920775e2-bb36-4d35-b845-dfad4256e202 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.062376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.063294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.063573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.063837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.073851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.075597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.085293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134e29-a2e2-43eb-a5af-20d183fd96ff None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:43.090693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:43.091574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:49:43.092449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:43.098858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 260/506] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:43.098858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.119769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.120376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.120650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.120945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.121656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:43.121948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.123307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.131843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 247/507] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:43.132604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.192958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.208607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3497b-bcad-4b8f-bf78-0cf1004964c2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.221864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.237151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2e9e-ce3d-456d-94e1-59e068253065 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.245018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.245633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.245908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.246208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.270377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.271004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.271277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.271544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.278935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.280361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:43.291279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:43.292204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:43.293206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 248/508] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:43.293762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.316727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.318240 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.394236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7eeab-233a-4a38-ac0e-f8a32afb78a3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.411903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.415120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 261/509] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:43.417175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.429094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.429719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.429996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.430257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.430992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:43.431295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.431957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.432744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.450803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 249/510] 10.222.0.89 () {56 vars in 1137 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:43.451802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.516581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a236859-0f20-48dd-adf9-fd93c0a2475a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.549282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.549905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.550180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.550477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.553051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa88b9-92da-46f3-af7c-3776bb4833a6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.560540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.562045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:43.576467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:43.577397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:43.578236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:43.578236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:43.578236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:43.578236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 262/511] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:43.578861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.589671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.590391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.590725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.591047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.601397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.602828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:43.617182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:43.618084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:43.619246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:43.619246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:43.619246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:43.619246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 250/512] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:43.619667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.643672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.648217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.681745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e172-5253-45d3-b769-171a3866d71e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.715087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.715692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.715969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.716236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.716994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:43.717298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.718737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.720054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21a126-fb34-4836-84f0-5ce45acb6aab None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.754522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 263/513] 10.222.0.89 () {56 vars in 1137 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:43.755354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.759711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.760369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.760644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.760939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.772431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.773843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:43.788148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:43.789242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:43.790060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:43.790060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:43.790060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:43.790060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 251/514] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:43.790060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.860892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc373b4-6696-482e-828f-1f16649a3a4a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.868066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.884871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:43.887847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc268653-c121-482e-bb61-51e55bae808f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:43.896339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.897013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.897289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.897542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.923182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33280427-d7be-4e94-9006-5f268285434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:43.923775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33280427-d7be-4e94-9006-5f268285434a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:43.924046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33280427-d7be-4e94-9006-5f268285434a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:43.924320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33280427-d7be-4e94-9006-5f268285434a None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:43.924971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33280427-d7be-4e94-9006-5f268285434a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:43.925267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33280427-d7be-4e94-9006-5f268285434a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.926620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33280427-d7be-4e94-9006-5f268285434a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:43.938062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 252/515] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:43.938898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33280427-d7be-4e94-9006-5f268285434a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:43.967525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:43.969024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.040285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33280427-d7be-4e94-9006-5f268285434a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.069841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 264/516] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:44.070733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.073888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.074670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.074977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.075368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.076002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:44.076298 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.077699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.086174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.094143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 253/517] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:44.094143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.096575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.174246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3919d9-5371-483f-ab37-648587b49063 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.192405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be51bd5-6381-466c-9be4-dc2485e4a30d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.208054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.208645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.208948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.209217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.228828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.229435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.229713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.229981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.230807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:44.231173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.232553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.249874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 254/518] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:44.249874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.289981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.291835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.305801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.314932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.347863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b388-9d7c-4a1b-868b-ee198c91b4ad None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.381240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.381868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.382149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.382423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.389695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.391141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.392720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 265/519] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:44.393416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:44.408079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:44.409093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 255/520] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:44.409991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.499688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32250a-195e-42e7-b122-73d11d85be70 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.511545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77cae2-a87f-4cdc-9bb2-4ef08188ca8d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.521945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.532146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.535004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.535640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.535914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.536189 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.546614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.547458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.548026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.548118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.548327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.548594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.549270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.550794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:44.562632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:44.563641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:44.564560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:44.564560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:44.564560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:44.564560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 266/521] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:44.564839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.576655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 256/522] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:49:44 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:49:44.577516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.677563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb436-c7e4-4ae2-978a-fb3dcf7b784a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.701031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5cebb-2530-49cf-b5fb-1db67541bbae None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.716065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.716379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.716657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.716951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.728218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.729757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.742657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:44.742919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:44.744048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:44.745055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:44.745488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.745488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.745488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.745669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 267/523] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:44.746082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.765739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.767440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:44.783074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:44.784044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:44.784908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:44.784908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:44.784908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:44.787567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 257/524] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:44.788603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.792338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.821258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:44.867078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58333f4f-bba9-4960-91c4-a6a92822b842 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.897525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297c62-d9d4-4053-a245-88fa9b8bb088 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:44.902996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.903713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.903997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.904268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.905053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:44.905356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.906792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.924855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 268/525] 10.222.0.89 () {56 vars in 1139 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:44.929918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:44.933231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:44.933904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:44.934365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:44.934851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:44.935510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:44.935811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:44.937199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:44.956127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 258/526] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:44.956127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.031125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.040669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f50d3-cd03-4f46-9d18-866205513795 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.051232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.064397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4dc01-12f9-4916-b977-806c56cf02de None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.078901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.079446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.079704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.079971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.080668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:45.080996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.082423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.099864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 269/527] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:45.104626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.110154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.110772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.111047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.111314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.111954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:45.112250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.114188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.134336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 259/528] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:45.134336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.211370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede8b87-1577-4125-988d-79bdae27596d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.241201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1d7c-493d-46e4-93b3-073852b6b523 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.246855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.247523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.247800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.248069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.269923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.279602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.280384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.280660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.281079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.287979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.289446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:45.301338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:45.302156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:45.302950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:45.307328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 260/529] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:45.308148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.319414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.321651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.323168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.414482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20cfac-f903-4e21-911e-24d5e7c3f508 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.428466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 270/530] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:45.429331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.455368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.455982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.456263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.456534 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.457297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=e9a6ec078043424aa591043afcc32c3a) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:45.457607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.459041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.466159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 261/531] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/role_assignments?user.id=e9a6ec078043424aa591043afcc32c3a&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:45.467077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.495567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.563438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.568560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8e03-e576-49a4-9640-dcddc158932d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.604075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5317f-bce2-4b55-befb-12d5676625b0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.614856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.615587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.616184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.616546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.626791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.628411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:45.640553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:45.641701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:45.642749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:45.649042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 271/532] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:45.650205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.652630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.653573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.654102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.654612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.655485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:45.655932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.657563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.677314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 262/533] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:45.678524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.777777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729e49-1362-4261-85c4-11f2a5bf9e61 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.791387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.813235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a206d-33cc-4d3e-9eb9-19128398a948 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.813711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.814350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.814628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.814901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.826722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.828187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:45.844515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:45.845503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:45.846903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:45.846903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:45.846903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:45.846903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 272/534] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:45.846903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.849107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:45.855106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:45.856013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:45.856483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:45.856992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:45.857982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:45.858494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:45.860210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:45.874165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 263/535] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:45.875455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:45.963656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3587f-5a90-44e3-ba20-74a55ef028eb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:45.983838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a21b46-5d5c-4dd2-a9cd-502056f4fa99 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:46.009804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:46.010799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.011326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.011602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.012387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=1c0449abfbe044b3aff4f24a5f1b7b86) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:46.012957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:46.015085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:46.021725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:46.022408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 273/536] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/role_assignments?user.id=1c0449abfbe044b3aff4f24a5f1b7b86&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:46.022528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.022786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.023158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.023263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:46.024119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:46.024519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:46.026054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:46.042670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 264/537] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:46.048751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:46.072101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:46.159290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12660c5e-d998-4721-aeb2-e2d95c3a946e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:46.199337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:46.200731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.201232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.201692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.202689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=84fd8059995549a892fe769eb07dc322) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:46.203190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:46.204947 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:46.212617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 274/538] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:46 2022] GET /identity/v3/role_assignments?user.id=84fd8059995549a892fe769eb07dc322&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:46.217688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:46.287992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee93c-89eb-40cb-a17c-c42554617f52 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:46.326944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:46.327956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.328503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.328990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.336751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:46.338614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:46.351304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:46.352214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:46.353061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:46.355589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 265/539] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:46.361634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:46.484221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:46.494351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50a59-3606-4d76-8697-e59b66a22d48 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:46.531023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e8547-79b9-484c-95aa-1cbc665e4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:46.531638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8547-79b9-484c-95aa-1cbc665e4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.531910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8547-79b9-484c-95aa-1cbc665e4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.532174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8547-79b9-484c-95aa-1cbc665e4ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.532934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e8547-79b9-484c-95aa-1cbc665e4ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:46.533291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e8547-79b9-484c-95aa-1cbc665e4ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:46.534759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e8547-79b9-484c-95aa-1cbc665e4ce8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:46.548375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 275/540] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:46.554431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:46.632204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f5133-1078-4383-8df1-24f14d3f44e6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.632204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f5133-1078-4383-8df1-24f14d3f44e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.632526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f5133-1078-4383-8df1-24f14d3f44e6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.635523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 276/541] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:46.640445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2a16-4e72-4228-bdfe-987b4ce8c7b2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.642621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2a16-4e72-4228-bdfe-987b4ce8c7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.642621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2a16-4e72-4228-bdfe-987b4ce8c7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.660218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a9a2a16-4e72-4228-bdfe-987b4ce8c7b2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:46.661611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a9a2a16-4e72-4228-bdfe-987b4ce8c7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:46.715987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcc88a-e96e-494f-8445-e95ca6fa8525 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:46.737057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 277/542] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:46.749226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:46.764401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:46.765395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:46.765868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:46.766346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:46.767297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=5007fe05c96e468b9dbc9b22ff1e2c26) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:46.767795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:46.773541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:46.780221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 266/543] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:46 2022] GET /identity/v3/role_assignments?user.id=5007fe05c96e468b9dbc9b22ff1e2c26&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:47.096572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a2a16-4e72-4228-bdfe-987b4ce8c7b2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:47.182617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:47.201779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a2a16-4e72-4228-bdfe-987b4ce8c7b2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:47.236538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:47.237192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:47.237464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:47.237726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:47.248708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:47.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:47.254413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:47.255183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:47.259509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 278/544] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:47.265908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:47.397944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bc0b-1d2a-4232-969e-7182b9b06263 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:47.434465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ad19a-ed73-4280-93fe-1cfc55fedb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:47.435424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad19a-ed73-4280-93fe-1cfc55fedb1b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:47.435915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad19a-ed73-4280-93fe-1cfc55fedb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:47.436373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad19a-ed73-4280-93fe-1cfc55fedb1b None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:47.437247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad19a-ed73-4280-93fe-1cfc55fedb1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:47.437738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad19a-ed73-4280-93fe-1cfc55fedb1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:47.439340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad19a-ed73-4280-93fe-1cfc55fedb1b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:47.448032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 267/545] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:47.454111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:47.571066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2b886-86bd-4f54-8ccb-ca1e99f68709 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:47.571714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2b886-86bd-4f54-8ccb-ca1e99f68709 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:47.572177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2b886-86bd-4f54-8ccb-ca1e99f68709 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:47.573806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 268/546] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:49:47.579801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2e06-7112-45af-8b9b-f73cd3fc1d77 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:47.580146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2e06-7112-45af-8b9b-f73cd3fc1d77 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:47.580430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2e06-7112-45af-8b9b-f73cd3fc1d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:47.602885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-84cf2e06-7112-45af-8b9b-f73cd3fc1d77 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:47.604437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-84cf2e06-7112-45af-8b9b-f73cd3fc1d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:47.622014 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce71cb6-1b6b-468f-b5d7-a3d6d37c1910 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:47.665235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:47.685368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:47.685988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:47.686262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:47.686527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:47.710945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:47.712407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:47.717109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:47.732006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 269/547] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:47.737113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:47.738211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:47.739119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:47.739119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:47.739119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:47.745165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 279/548] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:47.759085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2e06-7112-45af-8b9b-f73cd3fc1d77 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:47.889024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2e06-7112-45af-8b9b-f73cd3fc1d77 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:47.939438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:47.939965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:47.940237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:47.940502 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:47.941181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:47.941476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:47.942823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:47.959792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 270/549] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:47.965377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:48.092874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:48.120540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b007-cfa3-4452-b70e-2f9a4602392b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:48.152530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:48.189075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:48.190148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.190628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.191096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.205337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:48.208366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:48.223020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:48.224451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:49:48.225534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:48.229948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 280/550] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:49:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:48.237170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:48.301193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:48.314778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a436c3-82bb-493e-b21f-8151eaa8e1fb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:48.341492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e492421-b9bf-4c1e-97f4-6cacacae68ea None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:48.389841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:48.390826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.391309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.391787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.392718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:48.393235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:48.394846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:48.409509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:48.410337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.410447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.410723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.414413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 281/551] 10.222.0.89 () {56 vars in 1135 bytes} [Tue Aug 30 00:49:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:48.421156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:48.439706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:48.447858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:48.448831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:48.449838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:48.460432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 271/552] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:48.478124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:48.576763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:48.584347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66376c-5477-48d3-8f21-04a345c00799 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:48.591100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d251c-4edf-4797-9f08-8a435de0fcf2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:48.597649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:48.618112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d4853-0761-4c89-bec0-f4f04463586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:48.619027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4853-0761-4c89-bec0-f4f04463586b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.619299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4853-0761-4c89-bec0-f4f04463586b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.619570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4853-0761-4c89-bec0-f4f04463586b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.633496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164584-c95f-48d9-be29-3180c406ec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:48.634723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164584-c95f-48d9-be29-3180c406ec3f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.635177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164584-c95f-48d9-be29-3180c406ec3f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.635644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164584-c95f-48d9-be29-3180c406ec3f None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.636447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164584-c95f-48d9-be29-3180c406ec3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:48.636957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164584-c95f-48d9-be29-3180c406ec3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:48.638597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164584-c95f-48d9-be29-3180c406ec3f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:48.647513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 272/553] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:48.648977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81b11b-38c9-4aa2-980a-fec1cd0487a8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.649256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81b11b-38c9-4aa2-980a-fec1cd0487a8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.649528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81b11b-38c9-4aa2-980a-fec1cd0487a8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.650898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 273/554] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:48.653985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be27a1-52e5-4cc3-8adc-d8f429f8fe0c None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.654266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be27a1-52e5-4cc3-8adc-d8f429f8fe0c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.654537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be27a1-52e5-4cc3-8adc-d8f429f8fe0c None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.656083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 274/555] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:48.656956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be27a1-52e5-4cc3-8adc-d8f429f8fe0c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:48.697839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d4853-0761-4c89-bec0-f4f04463586b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:48.700066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d4853-0761-4c89-bec0-f4f04463586b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:48.768486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be27a1-52e5-4cc3-8adc-d8f429f8fe0c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:48.805211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e56d-4bc0-4fc1-bd7c-489f2e353aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:48.805911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e56d-4bc0-4fc1-bd7c-489f2e353aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.806367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e56d-4bc0-4fc1-bd7c-489f2e353aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.806679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e56d-4bc0-4fc1-bd7c-489f2e353aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.809167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 282/556] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:48.815029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ad537-b529-4239-a3d4-0f12dce9024d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.815317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ad537-b529-4239-a3d4-0f12dce9024d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.815589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ad537-b529-4239-a3d4-0f12dce9024d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.819659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e56d-4bc0-4fc1-bd7c-489f2e353aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:48.821131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e56d-4bc0-4fc1-bd7c-489f2e353aa4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:48.834288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-be3ad537-b529-4239-a3d4-0f12dce9024d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:48.835694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-be3ad537-b529-4239-a3d4-0f12dce9024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-aa29e56d-4bc0-4fc1-bd7c-489f2e353aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:48.837387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:48.838340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:48.839188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:48.839188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:48.839188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:48.839188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 275/557] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:48.840490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff414f9f-b78a-4e3b-9293-0089eee92077 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:48.840773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff414f9f-b78a-4e3b-9293-0089eee92077 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:48.841111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff414f9f-b78a-4e3b-9293-0089eee92077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:48.847987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:48.849967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:48.861024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ff414f9f-b78a-4e3b-9293-0089eee92077 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:48.862206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ff414f9f-b78a-4e3b-9293-0089eee92077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:48.925137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 283/558] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:48.926717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ad537-b529-4239-a3d4-0f12dce9024d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:48.933719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 276/559] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:48.934710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff414f9f-b78a-4e3b-9293-0089eee92077 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.036399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ad537-b529-4239-a3d4-0f12dce9024d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.043161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff414f9f-b78a-4e3b-9293-0089eee92077 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.071218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.071848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.072120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.072384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.075990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.082976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.083448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.084024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.084505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.084960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.085137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.086077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:49.086744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.087051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.089175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:49.101326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:49.102276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:49.103388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:49.103388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:49.103388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:49.103388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 284/560] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:49.105965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 277/561] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:49.108271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.113866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.230277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792fa2-a421-41aa-b503-1c8e2a5377b3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.230513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379f74d-fde0-47c7-bf61-21f50094c662 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.278725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c080807-8f74-4502-84ab-2df4764a05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.279368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c080807-8f74-4502-84ab-2df4764a05fb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.279642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c080807-8f74-4502-84ab-2df4764a05fb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.279909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c080807-8f74-4502-84ab-2df4764a05fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.288063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c080807-8f74-4502-84ab-2df4764a05fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.289484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c080807-8f74-4502-84ab-2df4764a05fb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-0c080807-8f74-4502-84ab-2df4764a05fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:49.302238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:49.303283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 278/562] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c2e0-4524-4045-ae38-040093c9d9b7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.304325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c2e0-4524-4045-ae38-040093c9d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.305486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c2e0-4524-4045-ae38-040093c9d9b7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.305660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 279/563] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:49.309731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c2e0-4524-4045-ae38-040093c9d9b7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.313598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.314224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.314498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.314763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.315427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:49.315727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.317179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.329452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 285/564] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:49.330248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.363465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.383357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.412889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c2e0-4524-4045-ae38-040093c9d9b7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.427662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1461df0-601b-4285-88ba-b5d65d7ecc45 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.447320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d59901-e0ee-4c04-af03-5e32c674accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.447930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59901-e0ee-4c04-af03-5e32c674accd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.448209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59901-e0ee-4c04-af03-5e32c674accd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.448479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59901-e0ee-4c04-af03-5e32c674accd None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.449265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d59901-e0ee-4c04-af03-5e32c674accd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:49.449562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d59901-e0ee-4c04-af03-5e32c674accd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.450983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d59901-e0ee-4c04-af03-5e32c674accd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.461533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.462154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.462431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.462707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.468163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 280/565] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:49.469384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdb707-e811-4fa8-92d9-7a5033477843 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.469666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdb707-e811-4fa8-92d9-7a5033477843 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.469937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdb707-e811-4fa8-92d9-7a5033477843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.477688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:49.482791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:49.483720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:49.484554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 286/566] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:49.485851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.487470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9cbdb707-e811-4fa8-92d9-7a5033477843 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:49.488665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9cbdb707-e811-4fa8-92d9-7a5033477843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:49.555908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 281/567] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:49.556641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdb707-e811-4fa8-92d9-7a5033477843 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.587410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6cf9e-2c6f-4d97-9262-e064dacd2906 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.599152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.603395 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.626603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.627350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.627526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.627761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.638600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:49.643510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:49.644425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 287/568] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:49.645596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.666920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdb707-e811-4fa8-92d9-7a5033477843 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.707193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.707832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.708117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.708488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.715316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.716765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:49.728099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:49.729201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 282/569] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:49.735305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.770511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ba56d-e287-482e-8b99-21dd12dbd050 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.804688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.805422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.805754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.806136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.816625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.818110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:49.833306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:49.834427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:49.835448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:49.835448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:49.835448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:49.835448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 288/570] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:49.835693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.837802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.842597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f706c-cfeb-4480-95cc-7f0c08d846ea None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.863504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:49.880518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.881154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.881434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.881712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.882403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:49.882705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.884086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.892339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 283/571] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:49.893163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.937358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab72d0c-b986-4879-a987-f1cfd0ac7752 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:49.970562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:49.971160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:49.971437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:49.971722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:49.972384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:49.972681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:49.974077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:49.982282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 289/572] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:49.983119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:49.993157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b41f8-697b-44f0-8f78-22d9af40001f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.027898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.029087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.029366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.029634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.030329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:50.030631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.032055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.044571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 284/573] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:50.045409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.070538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.075314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.097054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a6aa6-b59a-4a9c-87a0-4d798e74faf6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.132617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.133278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.133638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.133813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.146995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:50.153528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064025-3cd0-46ae-8953-f97466b17c88 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:50.154852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:50.155943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 290/574] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:50.157033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.190006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.190577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.190849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.191114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.191745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:50.192041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.193416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.204997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 285/575] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:50.209615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.260380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783caf1-4e38-4d07-a4f6-24c3ee3497d2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.290335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.297384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064206f9-2127-4522-a232-4c418919def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.298002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064206f9-2127-4522-a232-4c418919def1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.298277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064206f9-2127-4522-a232-4c418919def1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.298540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064206f9-2127-4522-a232-4c418919def1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.309883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064206f9-2127-4522-a232-4c418919def1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.310623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b9b3e-4d9a-43ad-a23b-b24f31465e32 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.311323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064206f9-2127-4522-a232-4c418919def1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.319213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-064206f9-2127-4522-a232-4c418919def1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:50.326375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:50.327292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:50.328178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:50.328178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:50.328178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:50.328178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 291/576] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:50.328405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064206f9-2127-4522-a232-4c418919def1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.348290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.348956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.349228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.349494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.360592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.362210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:50.377200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:50.378727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:50.379785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:50.379785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:50.379785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:50.379785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 286/577] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:50.379785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.432451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064206f9-2127-4522-a232-4c418919def1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.466223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.466804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.467074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.467337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.468061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=c589ae1e5d3843cd92fe1a125990771d) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:50.468358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.470187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.475423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 292/578] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/role_assignments?user.id=c589ae1e5d3843cd92fe1a125990771d&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:50.476186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.476773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9756214-f648-4103-8d7a-101398ff4bdc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.518202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.519117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.519391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.519654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.520325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:50.520621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.522088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.523910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.534908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 287/579] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:50.536315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.561425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.609031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d431e-5d48-4745-af1f-fd48448e5332 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.648659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331fc00-cc97-4b11-b4bf-18f5f27ed831 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.651275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.651913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.652212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.652504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.660256 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.661775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:50.674329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:50.675218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 293/580] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:50.681104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.691395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.692161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.692445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.692720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.693457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:50.693738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.695133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.711896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 288/581] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:50.711896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.777868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.798866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b500bb4-a3fd-4f58-858d-32d992469d41 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.822600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d4a0-6bf7-4615-bae1-f210b96b8d6b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:50.823528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:50.836385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.837013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.837292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.837776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.838203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:50.838502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.839954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.852631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 294/582] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:50.853472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.863043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:50.863611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:50.863883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:50.864147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:50.875356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:50.876777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:50.890582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:50.891562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:50.892417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:50.892417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:50.892417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:50.896342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 289/583] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:50.897239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:50.967217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68c24-2ee1-4209-bf1d-f9586fca9c2f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.004058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.004289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f8965-5321-46bd-8b39-a1a4b1a7b84f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.005226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.005788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.006391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.007157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:51.007470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.008937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.013344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.027487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 295/584] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:51.027487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.043883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.044566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.044899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.045177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.054928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.056437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:51.070626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:51.071647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 290/585] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:51.077891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.078543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.136503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5614c5-d05f-4865-af4f-963565ad5c91 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.172829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.173491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.173744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.174009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.181608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.183046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.187763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dbb50-2917-400a-a80d-a1ce451491be None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:51.195635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:51.196744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:49:51.197926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:51.204110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 296/586] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:51.204110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.223246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.223860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.224132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.224404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.225083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:51.225441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.226819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.244884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 291/587] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:51.244884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.274810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.314917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950862-6d55-49f5-b575-249d05bbcf8f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.317511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.352610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.353212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddb7e2-ede2-4e58-8c02-fd2f10987a32 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.353717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.354129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.354530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/e9a6ec078043424aa591043afcc32c3a/roles/33333e39653f4ee589cbae8b5422ddc8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.370313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=e9a6ec078043424aa591043afcc32c3a, role_id=33333e39653f4ee589cbae8b5422ddc8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.371997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.392967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.392967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.392967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.392967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.393725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:51.393826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 297/588] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:51 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/e9a6ec078043424aa591043afcc32c3a/roles/33333e39653f4ee589cbae8b5422ddc8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:51.393913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.396854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.397037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.417783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 292/589] 10.222.0.89 () {56 vars in 1137 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:51.419419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.533058 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.548589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2505da4-7cc3-4cbb-adf3-c9b04c8c5c17 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.561403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492faea-9a25-4864-b431-e36f5f1594d1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.601908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.602528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.602886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.603165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.604017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:51.604400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.605139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.606107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.606597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.606700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.607183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.615581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.617351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.627535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 298/590] 10.222.0.89 () {56 vars in 1137 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:51.628680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:51.636728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:51.637682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:49:51.638606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:51.641116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 293/591] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:51.642092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.648860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.756296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf7d7c-dec8-4f84-b4cf-99b3f795a3b9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.756717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d33c-c272-4be4-80ce-43436900d909 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.793127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.794131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.794438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:51.794850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.795071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:51.795351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:51.795624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.795939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:51.807003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.807315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:51.808974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.809256 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:51.816394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:51.825559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:51.826504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:51.827405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:51.827405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:51.827405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:51.827584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:51.828403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:51.829308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:51.829308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:51.829308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:51.829308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 294/592] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:51.829308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.836444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 299/593] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:51.836444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:51.917890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:51.968035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027aa1b-e259-4955-bad0-e0e3a10b9e16 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:51.971296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f321c-6d80-4ac5-819c-3ea5398e034b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.014420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.015706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.016282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.016740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.017089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.017378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.017655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.017923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.018686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:52.018790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:52.019035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.019520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.020459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.021343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.038690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 300/594] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:52.039852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.045034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 295/595] 10.222.0.89 () {56 vars in 1139 bytes} [Tue Aug 30 00:49:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:52.046007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.113071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:52.161263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6ea58-adce-41bd-8129-922084aa90f7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.178904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5f43f-c615-4dba-aaf4-50e7c3340533 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.197397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.198029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.198307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.198578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.210980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.212424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.217474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:52.224526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:52.225415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:52.226284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:52.229131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 296/596] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:52.229959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.233397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.234628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.235163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.236583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.237467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:52.237961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.239593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.260991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 301/597] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:52.260991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.361648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213438d-f8fe-4fc2-89e4-c4255ee43052 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.379556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:52.383007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0c69-cb08-4f0c-8c1d-1517c70cc3c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.402749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.403420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.403790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.404061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.415027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.416573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.422717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d089-cc22-41db-a185-342a43c72633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.423356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d089-cc22-41db-a185-342a43c72633 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.423631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d089-cc22-41db-a185-342a43c72633 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.423900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d089-cc22-41db-a185-342a43c72633 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.424593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d089-cc22-41db-a185-342a43c72633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:52.424934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d089-cc22-41db-a185-342a43c72633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.426375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d089-cc22-41db-a185-342a43c72633 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:52.431409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:52.432308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:52.434001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:52.434001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:52.434001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:52.434001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 297/598] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:52.434001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.445342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 302/599] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:52.447576 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e02e42-8b1e-4393-a963-832fc662a05a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.448061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e02e42-8b1e-4393-a963-832fc662a05a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.448678 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e02e42-8b1e-4393-a963-832fc662a05a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.451127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 303/600] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:52.452083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e02e42-8b1e-4393-a963-832fc662a05a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.504369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:52.550737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac619-60b0-473a-b089-cba4201128e5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.565037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e02e42-8b1e-4393-a963-832fc662a05a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.586625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.587343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.587688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.588020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.595223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.596727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.601054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961946ab-b39a-4b59-bcf7-2dc2830bd19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.601728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961946ab-b39a-4b59-bcf7-2dc2830bd19d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.602073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961946ab-b39a-4b59-bcf7-2dc2830bd19d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.602410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961946ab-b39a-4b59-bcf7-2dc2830bd19d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.603119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961946ab-b39a-4b59-bcf7-2dc2830bd19d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:52.603478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961946ab-b39a-4b59-bcf7-2dc2830bd19d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.604934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961946ab-b39a-4b59-bcf7-2dc2830bd19d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:52.609340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:52.610365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:52.611421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:52.617080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 298/601] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:52.617080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.619435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 304/602] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:52.620625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854767a-fcf8-492a-990e-331127550a2e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.621109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854767a-fcf8-492a-990e-331127550a2e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.621665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854767a-fcf8-492a-990e-331127550a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.639321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d854767a-fcf8-492a-990e-331127550a2e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:52.640646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d854767a-fcf8-492a-990e-331127550a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:52.652203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:52.712892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 305/603] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:52.713815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854767a-fcf8-492a-990e-331127550a2e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.746178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd086c4a-9baa-4b7b-9783-43266805848e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.757026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:52.798987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.800229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.800701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.801686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/1c0449abfbe044b3aff4f24a5f1b7b86/roles/33333e39653f4ee589cbae8b5422ddc8` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.822008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=1c0449abfbe044b3aff4f24a5f1b7b86, role_id=33333e39653f4ee589cbae8b5422ddc8)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.824190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.839056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854767a-fcf8-492a-990e-331127550a2e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:52.848052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 299/604] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:52 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/1c0449abfbe044b3aff4f24a5f1b7b86/roles/33333e39653f4ee589cbae8b5422ddc8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:52.848052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:52.921464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:52.922254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:52.922625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:52.922991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:52.923807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:52.924209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:52.925799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:52.956487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 306/605] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:52.967809 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.015120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:53.040457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86889f94-a693-4ead-b4b9-21045470f7f5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:53.087138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:53.088217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.088781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.089290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.097205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:53.098259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:53.100254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:53.105505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c29-3e7c-49b4-a4ad-bdf471b9917a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:53.113968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:53.114881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:53.115746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:53.118663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 300/606] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:53.119670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.147201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:53.148342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.148844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.149317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/84fd8059995549a892fe769eb07dc322/roles/33333e39653f4ee589cbae8b5422ddc8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.165796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=84fd8059995549a892fe769eb07dc322, role_id=33333e39653f4ee589cbae8b5422ddc8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:53.167632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:53.187504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 307/607] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:52 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/84fd8059995549a892fe769eb07dc322/roles/33333e39653f4ee589cbae8b5422ddc8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:53.189324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.238919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b00e5-a8f5-47be-a4ca-554805e6cd4c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:53.278959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:53.279736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.280380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.280380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.288206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:53.293740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:53.300034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:53.301135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:53.302059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:53.305102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 301/608] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:53.307823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.346668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889971c-8a69-48c1-a46e-41c49c34cefd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:53.384633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18262eed-ab4a-45e6-99ea-284e1e991677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:53.385369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18262eed-ab4a-45e6-99ea-284e1e991677 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.385580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18262eed-ab4a-45e6-99ea-284e1e991677 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.385820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18262eed-ab4a-45e6-99ea-284e1e991677 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.386576 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18262eed-ab4a-45e6-99ea-284e1e991677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:53.386887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18262eed-ab4a-45e6-99ea-284e1e991677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:53.388429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18262eed-ab4a-45e6-99ea-284e1e991677 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:53.408010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 308/609] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:53.409855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3e91c-981f-4599-a118-db1c9f460bd2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.410148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3e91c-981f-4599-a118-db1c9f460bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.410424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3e91c-981f-4599-a118-db1c9f460bd2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.416478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 309/610] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:53.417462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3e91c-981f-4599-a118-db1c9f460bd2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.431595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:53.447256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee0b7-b9f0-46d3-bdf5-84ab63af0711 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:53.488360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a234051-1fb5-4ae5-929c-f0ff8e983e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:53.489138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a234051-1fb5-4ae5-929c-f0ff8e983e3c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.489355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a234051-1fb5-4ae5-929c-f0ff8e983e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.489623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a234051-1fb5-4ae5-929c-f0ff8e983e3c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.490282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a234051-1fb5-4ae5-929c-f0ff8e983e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:53.490585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a234051-1fb5-4ae5-929c-f0ff8e983e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:53.492049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a234051-1fb5-4ae5-929c-f0ff8e983e3c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:53.501462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 302/611] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:53.502623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a454a9-a631-4ba2-8dbd-dacf9f7a5e45 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.502905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a454a9-a631-4ba2-8dbd-dacf9f7a5e45 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.503171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a454a9-a631-4ba2-8dbd-dacf9f7a5e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.522255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-18a454a9-a631-4ba2-8dbd-dacf9f7a5e45 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:53.523563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-18a454a9-a631-4ba2-8dbd-dacf9f7a5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:53.537283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3e91c-981f-4599-a118-db1c9f460bd2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:53.581933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:53.583487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.584098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:53.584600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.585318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/5007fe05c96e468b9dbc9b22ff1e2c26/roles/33333e39653f4ee589cbae8b5422ddc8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.597252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 303/612] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:53.601005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a454a9-a631-4ba2-8dbd-dacf9f7a5e45 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.617998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=5007fe05c96e468b9dbc9b22ff1e2c26, role_id=33333e39653f4ee589cbae8b5422ddc8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:53.619853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:53.648573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 310/613] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:53 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/5007fe05c96e468b9dbc9b22ff1e2c26/roles/33333e39653f4ee589cbae8b5422ddc8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:53.770355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a454a9-a631-4ba2-8dbd-dacf9f7a5e45 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:53.809274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:53.810090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:53.810433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:53.810767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:53.821958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:53.823540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:53.840601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:53.841824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:53.842721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:53.842721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:53.842721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:53.843235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 304/614] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:53.849982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.925852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:53.950149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:53.978881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e94ca-e9bf-48a0-950d-845543e19047 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:54.006962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:54.027242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:54.027869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:54.028387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:54.028660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:54.029802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:54.030401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:54.031783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:54.048099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 311/615] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:54.053683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:54.091765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd8bd-8ccf-4cad-9d11-1812fed64f06 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:54.178064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:54.179129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:54.179606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:54.180071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:54.210152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98fa91-e8d6-4d12-a95f-63642793f1ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:54.217468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:54.223169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:54.224138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:54.225001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:54.227659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 305/616] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:54.234753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:54.239562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:54.251827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:54.252634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:54.253051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:54.253420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:54.261959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:54.263521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:54.275732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:54.276898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:49:54.278513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:54.280164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 312/617] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:49:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:54.285757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:54.380965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1aa56-dc34-4e40-9036-80556f588033 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:54.382817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:54.432590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:54.433566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:54.434133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:54.434581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:54.435481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:54.435928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:54.437541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:54.459594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 306/618] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:54.462197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:54.489693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d269550-3e6e-49e6-bbc0-1bcb4343b275 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:54.563882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:54.564738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:54.565178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:54.565614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:54.566626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:54.567079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:54.568728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:54.609872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 313/619] 10.222.0.89 () {56 vars in 1135 bytes} [Tue Aug 30 00:49:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:54.615074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:54.661302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89f76-9f19-4064-800c-bb94474dc331 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:54.685151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:54.728996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:54.729637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:54.729912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:54.730271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:54.764400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:54.765907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:54.793583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:54.794774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:54.795660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:54.795660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:54.795660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:54.795660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 307/620] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:54.801769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:54.815413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdd4c5-35ab-45e3-93df-51fc0e1647fa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:54.852026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:54.863501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:54.864475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:54.864968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:54.865451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:54.889250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:54.891163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:54.915205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:54.916173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:54.917072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:54.917072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:54.917072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:54.925000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 314/621] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:49:54.929550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:54.991528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17176dd-7ca9-411e-9437-2085499982cb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.034476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d136422-1511-48df-8f0b-23e75ca6bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.035541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136422-1511-48df-8f0b-23e75ca6bb2e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.036028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136422-1511-48df-8f0b-23e75ca6bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.036487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136422-1511-48df-8f0b-23e75ca6bb2e None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.037375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d136422-1511-48df-8f0b-23e75ca6bb2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:55.037867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d136422-1511-48df-8f0b-23e75ca6bb2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:55.039461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d136422-1511-48df-8f0b-23e75ca6bb2e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:55.052618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 308/622] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:55.054256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4491ba-beae-4519-b4a3-d85a2e2536ee None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.054735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4491ba-beae-4519-b4a3-d85a2e2536ee None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.055216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4491ba-beae-4519-b4a3-d85a2e2536ee None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.057087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 309/623] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:55.057968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4491ba-beae-4519-b4a3-d85a2e2536ee None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:55.077085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:55.100722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e31a92-18dd-48ad-ab4e-77cf83a89aae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.147557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:55.150827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28071171-0de5-4509-95f7-9573f5daa847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.151484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071171-0de5-4509-95f7-9573f5daa847 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.151768 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071171-0de5-4509-95f7-9573f5daa847 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.152093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071171-0de5-4509-95f7-9573f5daa847 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.152938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28071171-0de5-4509-95f7-9573f5daa847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:55.153247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28071171-0de5-4509-95f7-9573f5daa847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:55.156047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28071171-0de5-4509-95f7-9573f5daa847 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:55.176881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 315/624] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:55.179735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f7ab-4868-4c02-8722-2985cefecc75 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.180012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f7ab-4868-4c02-8722-2985cefecc75 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.180277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f7ab-4868-4c02-8722-2985cefecc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.182419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4491ba-beae-4519-b4a3-d85a2e2536ee None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.202640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aac9f7ab-4868-4c02-8722-2985cefecc75 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:55.205106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aac9f7ab-4868-4c02-8722-2985cefecc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:55.223711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.224398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.224685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.224987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.233966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:55.236096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:55.250912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:55.251893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 310/625] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:49:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:55.253510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:55.302326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 316/626] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:55.302326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f7ab-4868-4c02-8722-2985cefecc75 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:55.411647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17079-22bd-4d2a-8b42-5a5929a26a30 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.456479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:55.474411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.475080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.475334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.475606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.482396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:55.491399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:55.492878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:55.505524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f7ab-4868-4c02-8722-2985cefecc75 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:55.519392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:55.520376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:55.521321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:55.522544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 311/627] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:55.528524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:55.572619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29f880-446e-4bac-8b1f-a648b4581f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.573258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29f880-446e-4bac-8b1f-a648b4581f0a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.573536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29f880-446e-4bac-8b1f-a648b4581f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.573833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29f880-446e-4bac-8b1f-a648b4581f0a None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.574586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29f880-446e-4bac-8b1f-a648b4581f0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:55.576036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29f880-446e-4bac-8b1f-a648b4581f0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:55.577535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29f880-446e-4bac-8b1f-a648b4581f0a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:55.598919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 317/628] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:49:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:55.600286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e51b4-401f-46ad-ace2-f8689c1c012c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.600569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e51b4-401f-46ad-ace2-f8689c1c012c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.600881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e51b4-401f-46ad-ace2-f8689c1c012c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.606675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 318/629] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:55.607662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e51b4-401f-46ad-ace2-f8689c1c012c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:55.674100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a471a9-05d4-43a0-b2a0-c6257be7cc38 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.708568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44809fa2-11b1-4c74-80c2-be62fee8c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.709217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809fa2-11b1-4c74-80c2-be62fee8c0cf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.709490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809fa2-11b1-4c74-80c2-be62fee8c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.709756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44809fa2-11b1-4c74-80c2-be62fee8c0cf None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.710504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809fa2-11b1-4c74-80c2-be62fee8c0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:55.711035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809fa2-11b1-4c74-80c2-be62fee8c0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:55.712207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44809fa2-11b1-4c74-80c2-be62fee8c0cf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:55.715110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e51b4-401f-46ad-ace2-f8689c1c012c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.725126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 312/630] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:49:55.726474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adc39-5a77-4fab-8210-1d85c58aba8e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.726869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adc39-5a77-4fab-8210-1d85c58aba8e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.727230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adc39-5a77-4fab-8210-1d85c58aba8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.750401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-de4adc39-5a77-4fab-8210-1d85c58aba8e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:55.750726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-de4adc39-5a77-4fab-8210-1d85c58aba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:55.760038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:55.768299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.769069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.769682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.769961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.804345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:55.828842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 313/631] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:55.828842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4adc39-5a77-4fab-8210-1d85c58aba8e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:55.854166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:55.856387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:55.937209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4adc39-5a77-4fab-8210-1d85c58aba8e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:55.974206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9cb64-f67e-4bc5-8f49-53f06f9ba2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:55.974843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9cb64-f67e-4bc5-8f49-53f06f9ba2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.975118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9cb64-f67e-4bc5-8f49-53f06f9ba2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.975386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9cb64-f67e-4bc5-8f49-53f06f9ba2c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:55.985252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 319/632] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:55.986067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:55.990927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9cb64-f67e-4bc5-8f49-53f06f9ba2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b2e9cb64-f67e-4bc5-8f49-53f06f9ba2c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:55.996213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:55.997384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:55.998338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 314/633] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:55.999195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557643d-444e-40b0-b2e4-f4537e50ace5 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:55.999195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557643d-444e-40b0-b2e4-f4537e50ace5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:55.999337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557643d-444e-40b0-b2e4-f4537e50ace5 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.004456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 315/634] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:56.005253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557643d-444e-40b0-b2e4-f4537e50ace5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.023629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.061098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.098156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc0547-dbed-4bb2-aeb6-4a60c6bfa326 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.122155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557643d-444e-40b0-b2e4-f4537e50ace5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.134781 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.135441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.135717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.135990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/c589ae1e5d3843cd92fe1a125990771d/roles/33333e39653f4ee589cbae8b5422ddc8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.150592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=c589ae1e5d3843cd92fe1a125990771d, role_id=33333e39653f4ee589cbae8b5422ddc8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:56.152232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:56.155743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11e143-2a16-4578-b215-f5ad12350698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.156379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e143-2a16-4578-b215-f5ad12350698 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.156708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e143-2a16-4578-b215-f5ad12350698 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.157013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11e143-2a16-4578-b215-f5ad12350698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.184832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 320/635] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:49:55 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/c589ae1e5d3843cd92fe1a125990771d/roles/33333e39653f4ee589cbae8b5422ddc8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:49:56.184832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.185120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11e143-2a16-4578-b215-f5ad12350698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:56.185120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11e143-2a16-4578-b215-f5ad12350698 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-cc11e143-2a16-4578-b215-f5ad12350698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:56.185781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:56.186732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:56.187683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:56.187683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:56.187683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:56.187683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 316/636] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:56.188506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbfeb-d884-4496-84ee-3a3db6f3f32e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.188506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbfeb-d884-4496-84ee-3a3db6f3f32e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.189022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbfeb-d884-4496-84ee-3a3db6f3f32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.208518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4e6fbfeb-d884-4496-84ee-3a3db6f3f32e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:56.209983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4e6fbfeb-d884-4496-84ee-3a3db6f3f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:56.267557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.292097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 317/637] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:56.292097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fbfeb-d884-4496-84ee-3a3db6f3f32e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.300602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7150-2a45-47dd-bf1f-26a4da0ecf20 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.331357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.360292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.361317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.361807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.362213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.363054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:56.363502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:56.365148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:56.376407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 321/638] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:56.377541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.431561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fbfeb-d884-4496-84ee-3a3db6f3f32e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.476748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.477449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.477587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.477865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.491501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcb15b-a41a-409b-b6ce-29e3634cb13d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.492148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:56.499108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:56.500326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:56.501395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:56.502776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 318/639] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:56.504273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.533008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.534208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.534734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.534994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.535646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:56.535941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:56.537366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:56.550769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 322/640] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:56.551804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.556363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.609442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.625327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84993528-cdda-4887-a32a-88e72a07b74e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.663624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.664256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.664529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.664794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.666491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e58663-fad1-4714-b0d9-daa6db0748be None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.677345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:56.678781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:56.693614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:56.694630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:56.695493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:56.695493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:56.695493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:56.695493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 319/641] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:56.695493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.713541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.714150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.714496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.715081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.716043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:56.716345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:56.717765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:56.730814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 323/642] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:56.730814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.803608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.815262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed8c5-87da-48fc-97a6-7d5e5611298e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.846734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c794f3-14aa-4a39-992f-07ff868581f5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:56.853782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.854424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.854702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.854972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.862522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:56.863959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:56.866641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:56.878215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:56.879185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 320/643] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:56.880060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.891567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:56.892194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:56.892481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:56.892755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:56.903894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:56.909252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:56.910160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:56.911055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 324/644] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:56.912386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:56.991000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821eb4-a513-4c5b-b334-deb9ec51a93a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.019968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df821f0-4a42-45da-8805-8a33061fd00c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.026068 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.026681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.027022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.027475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.028215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:57.028529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.029935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.041694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 321/645] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:57.042722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.053837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.065205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.066027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.066478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.066899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.078658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.080299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:57.096109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:57.097237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:57.098270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:57.098270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:57.098270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:57.099799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 325/646] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:57.100699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.114972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.160632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9356b-8e3f-45fd-b34a-c4232d6acfd7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.196267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.196904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.197203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.197456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.198160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:57.198465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.200147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.212692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 322/647] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:57.213587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.224456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92876a-f479-4dee-bd78-01396e33901e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.259747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.260386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.260568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.260851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.261719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:57.262058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.263413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.276471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 326/648] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:57.276471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.321924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.329882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e5fd-ed59-4225-94b8-42a2dbabc5fa None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.350376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.366196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.367137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.367421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.367850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.376647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.378133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.384615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1143-b8d7-4cce-8aea-adf84d10b3f0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:57.389478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:57.390418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 323/649] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:57.396469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.425553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313968-e3af-4988-b025-770eab364761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.426154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313968-e3af-4988-b025-770eab364761 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.426436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313968-e3af-4988-b025-770eab364761 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.426714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313968-e3af-4988-b025-770eab364761 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.427380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313968-e3af-4988-b025-770eab364761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:57.427683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313968-e3af-4988-b025-770eab364761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.429083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313968-e3af-4988-b025-770eab364761 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.440953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 327/650] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:57.441588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313968-e3af-4988-b025-770eab364761 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.517556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c173e-9948-4c1b-8edc-761f772824dd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.548267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.551975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313968-e3af-4988-b025-770eab364761 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.563244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.563954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.565063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.565343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.566084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=e9a6ec078043424aa591043afcc32c3a) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:57.566390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.567925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.574724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 324/651] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/role_assignments?user.id=e9a6ec078043424aa591043afcc32c3a&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:57.575598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.603594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.604978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.605625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.606770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.623664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.626223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.630700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:57.652749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:57.654084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:57.654964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:57.654964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:57.654964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:57.659701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 328/652] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:57.661073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.702391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03214853-e11b-4afa-9f91-8644e66a9673 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.751776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.755125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.755125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.755125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.755125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:57.755125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.756705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.778992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 325/653] 10.222.0.89 () {56 vars in 1137 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:57.779720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.790372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf59bc2-caff-4d25-bf01-408d5404d2ac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.839375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:57.840255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:57.840656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:57.840966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:57.850158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:57.851683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:57.865493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:57.866476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 329/654] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:57.867889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:57.899960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.948832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862559d-e999-4920-b72f-e729443a2936 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:57.949701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:57.992496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf215a-1f76-4bdf-81d2-4bc3635d7d7d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.000674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.001350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.001645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.002249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.002647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:58.002951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.004357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.028834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 326/655] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:58.029825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:58.033898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.034740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.035155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.035603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.113908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.115620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.131511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:58.189489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efe643-c1c1-43c9-bd26-8520353114c9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.239962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bac5a-4bb9-4286-a65f-3c4c805d1663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.240171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 330/656] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:58.240420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bac5a-4bb9-4286-a65f-3c4c805d1663 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.240631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bac5a-4bb9-4286-a65f-3c4c805d1663 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.240923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bac5a-4bb9-4286-a65f-3c4c805d1663 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.241662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bac5a-4bb9-4286-a65f-3c4c805d1663 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:58.241959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bac5a-4bb9-4286-a65f-3c4c805d1663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.243751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bac5a-4bb9-4286-a65f-3c4c805d1663 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.245880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:58.269252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 327/657] 10.222.0.89 () {56 vars in 1137 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:58.269252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d2e4f-23c7-4eb0-8901-b01a090261d8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.269252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d2e4f-23c7-4eb0-8901-b01a090261d8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.269252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d2e4f-23c7-4eb0-8901-b01a090261d8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.273637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 328/658] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:58.274420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d2e4f-23c7-4eb0-8901-b01a090261d8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:58.299111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:58.363692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25546e81-2fd2-453a-abc3-0b94b37e20c8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.381876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:58.409848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.410670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.411041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.411414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.413977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d2e4f-23c7-4eb0-8901-b01a090261d8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.419358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.420936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:49:58.432784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:58.434452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:49:58.435643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:58.441648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 331/659] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:58.443001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:58.457573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a98db-dbaf-4819-9f99-0745b8a2979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.458196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a98db-dbaf-4819-9f99-0745b8a2979b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.458474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a98db-dbaf-4819-9f99-0745b8a2979b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.458740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a98db-dbaf-4819-9f99-0745b8a2979b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.469910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a98db-dbaf-4819-9f99-0745b8a2979b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.471391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a98db-dbaf-4819-9f99-0745b8a2979b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-704a98db-dbaf-4819-9f99-0745b8a2979b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:58.486115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:58.487089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:58.487955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:58.487955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:58.487955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:58.487955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 329/660] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:58.488461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571971-a50f-4e44-84ad-a05339101a15 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.488560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571971-a50f-4e44-84ad-a05339101a15 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.488849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8571971-a50f-4e44-84ad-a05339101a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.507111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c8571971-a50f-4e44-84ad-a05339101a15 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:49:58.508297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c8571971-a50f-4e44-84ad-a05339101a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:49:58.561522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c20cd-291d-4824-be1c-1d4d043449eb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.580844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 330/661] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:49:58.580844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8571971-a50f-4e44-84ad-a05339101a15 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:58.580844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:58.608016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.608733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.609051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.609316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.655375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:58.689613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.691490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.723212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8571971-a50f-4e44-84ad-a05339101a15 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.779021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.779973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.780650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.781992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.782928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:58.783421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.785021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.809193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 331/662] 10.222.0.89 () {56 vars in 1139 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:58.810676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:58.820945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 332/663] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:58.821994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:58.886439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:58.894906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:58.927378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e04fa1-daac-4fba-8f9c-94a4f880889a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.930436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0d65-65fa-4a7b-a861-1c8cd0f66f8b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:58.965057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.965345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:58.965689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.965896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:58.965993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.966171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:58.966276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.966439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:58.966873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:58.967183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:58.968651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:58.980846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 332/664] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:58.981630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.050886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.052388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.092506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74e60b-25a3-4e64-90f7-2ac0259665ef None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.113782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.128928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.129936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.129936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.130109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.130751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.141402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.143093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:59.158423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:59.159530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:59.160439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:59.160439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:59.160439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:59.160439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 333/665] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:59.161024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.170325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 333/666] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:59.175041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.268459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaadd79-c83d-44ca-813f-0ab52227a770 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.280839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd985a9-068a-4be6-9fe6-0dd6e0a6c810 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.303686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.304608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.304919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.305170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.317698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:49:59.318738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.319362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.319639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.319906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:49:59.323442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:59.324509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 334/667] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:59.329800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.330534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.330534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:59.340780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:59.341892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 334/668] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:59.342808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.370220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.379504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.447161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148d4c-1a31-4d7d-b7d6-26db5b47f299 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.455412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13ded-0858-40a3-9b59-0d0b6a1d6895 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.481505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.482102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.482375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.482642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.483278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:59.483572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.484961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.496501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.497326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 335/669] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:59.497582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.497979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.498153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.498513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.513811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.515918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:59.536537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:59.537882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:59.543826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:59.543826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:59.543826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:49:59.543826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 335/670] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:59.543826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.600604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.611848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31cd2e-5502-4d40-a4e7-eb6a631e0029 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.639815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.650769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.651380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.651652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.651947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.652608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:59.652935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.654293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.657368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca6a0-63ad-4ee7-84c3-191dcc63fc1e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.662278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 336/671] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:59.663059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.691781 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.692387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.692666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.692971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.693673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:59.694007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.695441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.708175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 336/672] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:59.709000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.762992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454565-b25c-4494-8247-1a80dc4098f2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.796010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bea16-7373-4e0c-923b-935ed435206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.796636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bea16-7373-4e0c-923b-935ed435206b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.796945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bea16-7373-4e0c-923b-935ed435206b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.797223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bea16-7373-4e0c-923b-935ed435206b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.803823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bea16-7373-4e0c-923b-935ed435206b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.805287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bea16-7373-4e0c-923b-935ed435206b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.809423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de49f4-8e5b-4d8a-80a8-534bf74de5ba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-294bea16-7373-4e0c-923b-935ed435206b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:49:59.817582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:59.818478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 337/673] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993fc2-f142-4ab8-8cb5-303801fb8049 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.824269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993fc2-f142-4ab8-8cb5-303801fb8049 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.824896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993fc2-f142-4ab8-8cb5-303801fb8049 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.824896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 338/674] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:49:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:49:59.824896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85993fc2-f142-4ab8-8cb5-303801fb8049 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.838482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.847792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.848401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.848681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.848988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.849635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:49:59.849932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.851361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.863141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 337/675] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:49:59.863775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:49:59.871321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:59.925784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85993fc2-f142-4ab8-8cb5-303801fb8049 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.958912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:49:59.959571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:49:59.959843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:49:59.960106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:49:59.964044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ce22-9d7f-40be-8f0e-ea85b34a4ace None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:49:59.970808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:49:59.972266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:49:59.986552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:49:59.987655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:49:59.988539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:49:59.988539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:49:59.988539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:49:59.988539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 339/676] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:49:59.988539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.000329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8275a-d405-43eb-b06c-dc8b1881793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.001040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8275a-d405-43eb-b06c-dc8b1881793e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.001746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8275a-d405-43eb-b06c-dc8b1881793e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.002019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8275a-d405-43eb-b06c-dc8b1881793e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.002750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8275a-d405-43eb-b06c-dc8b1881793e None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=1c0449abfbe044b3aff4f24a5f1b7b86) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:00.003053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8275a-d405-43eb-b06c-dc8b1881793e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.004825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8275a-d405-43eb-b06c-dc8b1881793e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.010505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 338/677] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/role_assignments?user.id=1c0449abfbe044b3aff4f24a5f1b7b86&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:00.011615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaedcb-7788-479f-a42b-becef69a35fa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.012078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaedcb-7788-479f-a42b-becef69a35fa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.012348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaedcb-7788-479f-a42b-becef69a35fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.032037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-13eaedcb-7788-479f-a42b-becef69a35fa None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:00.033316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-13eaedcb-7788-479f-a42b-becef69a35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:00.072595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:00.105209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:00.117029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 339/678] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:00.117029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaedcb-7788-479f-a42b-becef69a35fa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.122500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e3fb4-2f88-437c-a609-d371bf10cd22 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.163913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.164527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.164868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.165158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.165806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:00.166272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.167542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.181584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 340/679] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:00.182427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.239379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaedcb-7788-479f-a42b-becef69a35fa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.288235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.289024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.289302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.289583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.296005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d224f93-97f5-4428-8d63-ad580088f204 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.299353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.300532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:00.313872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:00.314790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:00.315667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 340/680] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:00.316149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.330493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:00.343649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.345113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.345593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.346274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.347159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:00.347858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.350114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.366506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 341/681] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:00.368053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.385453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:00.439071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4dd65-86ef-489a-8d64-fe68bc41e7ba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.475272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.475865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.476142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.476408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.477172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=84fd8059995549a892fe769eb07dc322) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:00.477476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.478907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.485123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109efafb-0079-43a3-8a7f-acf58a77191d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.485342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 341/682] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/role_assignments?user.id=84fd8059995549a892fe769eb07dc322&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:00.486116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.536028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.537071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.537529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.538077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.539103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:00.539411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.540909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.556891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 342/683] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:00.557794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.615767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:00.637969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5586ad2-97b1-44c4-8bca-369a052489bd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.670872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:00.680959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b6b8e-5c5b-4ec7-b4b7-7e930b738c2b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.692693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.693371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.693648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.693912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.702217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.703673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:00.718257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:00.719281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 342/684] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:00.720207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.724758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.725445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.725724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.725990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.738687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:00.743778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:00.744761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:00.745725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 343/685] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:00.746407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.858828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f11863-d5eb-4c3d-8a15-97e2ba34e937 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.877692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2bbd-b012-4482-8bdf-3935a8a52d3b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:00.885207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:00.899065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.900024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.900445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.900975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.901977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=5007fe05c96e468b9dbc9b22ff1e2c26) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:00.902431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.904410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.911548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 343/686] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/role_assignments?user.id=5007fe05c96e468b9dbc9b22ff1e2c26&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:00.912517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.914699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:00.915334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:00.915627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:00.915864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:00.916621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:00.916948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:00.919369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:00.939598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 344/687] 10.222.0.89 () {56 vars in 1135 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:00.945272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:00.969551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:01.033137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a403a-8330-42f1-9cb8-1865d3edb171 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:01.055649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678333c-9748-43e9-bee3-dc909764de9e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:01.073217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:01.074158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:01.074577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:01.075201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:01.076156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:01.076725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:01.078266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:01.088482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 344/688] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:01.095222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:01.101490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:01.102117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:01.102391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:01.102660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:01.166990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:01.220774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:01.222546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:01.262739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb1799-9402-4d5f-88cc-ff350318d745 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:01.276376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:01.315546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:01.315889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:01.316171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:01.316500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:01.332789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:01.334809 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:01.354780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:01.356017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:01.357152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:01.357152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:01.357152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:01.357152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 345/689] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:01.357429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 345/690] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:50:01.364687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:01.365127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:01.479110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:01.536323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa503e90-22de-4a35-a89f-5d7bef212131 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:01.547446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aabb7-6cff-43e5-bfac-081dfe33679d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:01.576691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:01.578158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:01.578804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:01.579280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:01.593399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:01.595712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:01.604431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:01.604924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:01.605206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:01.605474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:01.606123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:01.606425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:01.607959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:01.615385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:01.616410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:01.617329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:01.617329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:01.617329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:01.618688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 346/691] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:01.626434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 346/692] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:01.626927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:01.628585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:01.645987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:01.797803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defc269-1e88-4215-9957-903a33f92776 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:01.857736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f8d35-10e5-4102-b1a1-d9dbc4d57914 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:01.872606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:01.873246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:01.873518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:01.873785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:01.874494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:01.874793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:01.876167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:01.894830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 347/693] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:01.900686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:01.930179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:01.961523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:01.962182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:01.962463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:01.962736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:01.982055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:01.983382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:01.983507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:02.006339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:02.007547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:02.008716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:02.010370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 347/694] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:50:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:02.017687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:02.043163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78397c99-ae2a-496b-969f-7195ff071720 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:02.084887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:02.085796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.086220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.086636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.094180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:02.095811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:02.107892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:02.109033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:02.110010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:02.112221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 348/695] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:02.119458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:02.170767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55565fd-3e71-47db-8560-7f9b06c66690 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:02.236652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:02.237318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.237691 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.237965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.238711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:02.239016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:02.240454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:02.270159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37327b-e80e-4535-8476-01dd16697047 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:02.275276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 348/696] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:50:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:02.289785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:02.307357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:02.317533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:02.318147 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.318427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.318692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.319397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:02.319691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:02.329282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:02.347037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:02.359089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 349/697] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:02.366473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:02.424670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67e726-019f-4dde-88ee-5992239cf6f5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:02.472782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7630d-3fc0-4c93-998c-64321218a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:02.473867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7630d-3fc0-4c93-998c-64321218a514 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.474355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7630d-3fc0-4c93-998c-64321218a514 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.474860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7630d-3fc0-4c93-998c-64321218a514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.519031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dea9-d115-42fe-b18e-3a280ea760ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:02.552137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7630d-3fc0-4c93-998c-64321218a514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:02.554464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7630d-3fc0-4c93-998c-64321218a514 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:02.556348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c671-7800-4a32-8de0-14e33d525cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:02.557112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c671-7800-4a32-8de0-14e33d525cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.557388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c671-7800-4a32-8de0-14e33d525cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.557654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c671-7800-4a32-8de0-14e33d525cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.558612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c671-7800-4a32-8de0-14e33d525cb1 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=c589ae1e5d3843cd92fe1a125990771d) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:02.558912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c671-7800-4a32-8de0-14e33d525cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:02.560444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c671-7800-4a32-8de0-14e33d525cb1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:02.572868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 350/698] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:02 2022] GET /identity/v3/role_assignments?user.id=c589ae1e5d3843cd92fe1a125990771d&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:02.572868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9dac-3f07-4cf5-b464-58cd99fe4718 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.572868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9dac-3f07-4cf5-b464-58cd99fe4718 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.572868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9dac-3f07-4cf5-b464-58cd99fe4718 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.572868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 351/699] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:02.582836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a7711-a1c1-4614-8d76-f8fe0e36dae2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.583173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a7711-a1c1-4614-8d76-f8fe0e36dae2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.583429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a7711-a1c1-4614-8d76-f8fe0e36dae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.620360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1e3a7711-a1c1-4614-8d76-f8fe0e36dae2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:02.621624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1e3a7711-a1c1-4614-8d76-f8fe0e36dae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:02.654300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:02.715810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:02.731839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 349/700] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:50:02.733623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca81f0-bb0e-4fc2-8a33-9c3903250071 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.733913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca81f0-bb0e-4fc2-8a33-9c3903250071 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.734181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca81f0-bb0e-4fc2-8a33-9c3903250071 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.737213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 350/701] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:02.737954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca81f0-bb0e-4fc2-8a33-9c3903250071 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:02.750354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 352/702] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:02.750354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f449dc-e433-4432-86db-b4c7cf5cdc22 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.750354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f449dc-e433-4432-86db-b4c7cf5cdc22 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.750354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f449dc-e433-4432-86db-b4c7cf5cdc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.784623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-71f449dc-e433-4432-86db-b4c7cf5cdc22 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:02.786473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-71f449dc-e433-4432-86db-b4c7cf5cdc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:02.863312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 353/703] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:02.866637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca81f0-bb0e-4fc2-8a33-9c3903250071 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:02.903546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:02.904470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:02.904916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:02.905367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:02.915927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:02.917686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:02.925118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:02.933768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:02.935096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:02.936241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:02.936241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:02.936241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:02.938225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 351/704] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:02.943502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f449dc-e433-4432-86db-b4c7cf5cdc22 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.055271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f449dc-e433-4432-86db-b4c7cf5cdc22 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.058587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.080305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:03.106095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.107068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.107338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.107599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.108252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:03.108547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.110113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.122860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 354/705] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:03.131292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.218537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6578f-abdb-4178-82c4-d89f629b69e6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.253976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.254613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.254891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.255166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.267372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.267548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fdfe2-50c4-44d8-bdaf-3a6001c70003 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.268843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:03.284511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:03.285542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:03.286410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:03.286410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:03.286410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:03.286410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 352/706] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:03.287094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.307522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.308536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.308825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.309103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.318443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.320403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:03.335739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:03.337503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 355/707] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:03.340033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.340970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:03.377064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:03.403066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03932d-4fe5-4955-9ba5-aa682eb86123 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.438956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49373b34-fb61-4755-8ec3-754359917ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.439634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373b34-fb61-4755-8ec3-754359917ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.439909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373b34-fb61-4755-8ec3-754359917ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.440177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373b34-fb61-4755-8ec3-754359917ae0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.440775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49373b34-fb61-4755-8ec3-754359917ae0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.442220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49373b34-fb61-4755-8ec3-754359917ae0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.446568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347da46-6681-48c9-9d36-026820aa3dfb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-49373b34-fb61-4755-8ec3-754359917ae0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:03.453582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:03.454599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:03.457796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 353/708] 10.222.0.89 () {56 vars in 1129 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:03.458578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba90b4-c798-4bf9-a0cd-226381c163a7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.458578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba90b4-c798-4bf9-a0cd-226381c163a7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.458578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba90b4-c798-4bf9-a0cd-226381c163a7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.461072 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 354/709] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:03.462178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba90b4-c798-4bf9-a0cd-226381c163a7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.488632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.489262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.489535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.489799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.490437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:03.490732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.492284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.509045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 356/710] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:03.509045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.570934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba90b4-c798-4bf9-a0cd-226381c163a7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.581852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:03.606763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:03.607903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315c6eb-3063-4a3a-97f0-5d6ee40f03a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.608559 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315c6eb-3063-4a3a-97f0-5d6ee40f03a1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.608913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315c6eb-3063-4a3a-97f0-5d6ee40f03a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.609142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315c6eb-3063-4a3a-97f0-5d6ee40f03a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.610002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315c6eb-3063-4a3a-97f0-5d6ee40f03a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:03.610311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315c6eb-3063-4a3a-97f0-5d6ee40f03a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.611775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315c6eb-3063-4a3a-97f0-5d6ee40f03a1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.615688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d65ca-752a-446e-ae1c-9bafafb87287 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.624729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 355/711] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:03.626903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522855a-3f45-4183-87cd-150e75cd7cd4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.627867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522855a-3f45-4183-87cd-150e75cd7cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.628344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522855a-3f45-4183-87cd-150e75cd7cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.648369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3522855a-3f45-4183-87cd-150e75cd7cd4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:03.649583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3522855a-3f45-4183-87cd-150e75cd7cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:03.653301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.653486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.653754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.654021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.654646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:03.654941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.656304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.664880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 357/712] 10.222.0.89 () {56 vars in 1124 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:03.664880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.722892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 356/713] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:03.723615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522855a-3f45-4183-87cd-150e75cd7cd4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.789277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01b53-6209-487c-9147-1a09c6ac4360 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.823722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.824418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.824762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.825127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.825847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.827384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.857344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:03.858253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 358/714] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:50:03 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:03.859710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:03.860381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522855a-3f45-4183-87cd-150e75cd7cd4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:03.903401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:03.906046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:03.907021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:03.907532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:03.908030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:03.909004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=e9a6ec078043424aa591043afcc32c3a) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:03.909563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:03.911747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:03.922030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 357/715] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/role_assignments?user.id=e9a6ec078043424aa591043afcc32c3a&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:04.040518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb405-d934-4382-a759-92b5ac74310f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:04.049272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:04.088689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:04.089761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:04.090415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:04.090824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:04.091657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:04.092076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:04.093624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:04.100870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 359/716] 10.222.0.89 () {56 vars in 1124 bytes} [Tue Aug 30 00:50:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:04.178810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7ff1-b97f-4cbc-b87d-a0874fd22fce None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:04.229700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:04.230845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:04.231126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:04.231395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:04.232096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:04.233545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:04.244494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:04.245818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:04.246997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 358/717] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:04 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:04.253968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:04.360834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:04.381986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d777cb-459f-4877-9e1a-fe572d5ece70 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:04.423955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743ec93-650d-4385-9a2f-f33b806b5909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:04.424595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ec93-650d-4385-9a2f-f33b806b5909 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:04.424890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ec93-650d-4385-9a2f-f33b806b5909 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:04.425156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ec93-650d-4385-9a2f-f33b806b5909 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:04.425798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743ec93-650d-4385-9a2f-f33b806b5909 None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:04.426094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743ec93-650d-4385-9a2f-f33b806b5909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:04.427484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743ec93-650d-4385-9a2f-f33b806b5909 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:04.432461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 360/718] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:04.438367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:04.491575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:04.588132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716914cd-3a9f-4a94-959f-c417aca206e6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:04.634691 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d50758-b9ee-475b-a8ea-0d495c3b9768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:04.635311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d50758-b9ee-475b-a8ea-0d495c3b9768 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:04.635585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d50758-b9ee-475b-a8ea-0d495c3b9768 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:04.635855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d50758-b9ee-475b-a8ea-0d495c3b9768 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:04.636698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d50758-b9ee-475b-a8ea-0d495c3b9768 None admin] RBAC: Adding query filter params (type=network) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:04.637249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d50758-b9ee-475b-a8ea-0d495c3b9768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:04.638605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d50758-b9ee-475b-a8ea-0d495c3b9768 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:04.647084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 359/719] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:05.048503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ec41c-17e6-49f7-a39e-d6ad80e72e18 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:05.049023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ec41c-17e6-49f7-a39e-d6ad80e72e18 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:05.049023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ec41c-17e6-49f7-a39e-d6ad80e72e18 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:05.050743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 361/720] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:05.057875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e195-c8b6-4741-a23c-91077ac90554 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:05.058322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e195-c8b6-4741-a23c-91077ac90554 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:05.058592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e195-c8b6-4741-a23c-91077ac90554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:05.085839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-df82e195-c8b6-4741-a23c-91077ac90554 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:05.087055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-df82e195-c8b6-4741-a23c-91077ac90554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:05.178261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 360/721] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:05.581823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ec41c-17e6-49f7-a39e-d6ad80e72e18 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:05.718074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ec41c-17e6-49f7-a39e-d6ad80e72e18 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:05.767202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:05.767838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:05.768116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:05.768382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:05.786715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:05.792017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:05.793021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:05.793848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:05.795093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 362/722] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:05.799359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e195-c8b6-4741-a23c-91077ac90554 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:05.830803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:05.917195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e195-c8b6-4741-a23c-91077ac90554 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:05.960323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f31b2-8101-4d61-8a9f-1046f3ffd838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:05.960980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f31b2-8101-4d61-8a9f-1046f3ffd838 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:05.961258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f31b2-8101-4d61-8a9f-1046f3ffd838 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:05.961530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f31b2-8101-4d61-8a9f-1046f3ffd838 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:05.962199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f31b2-8101-4d61-8a9f-1046f3ffd838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:05.962497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f31b2-8101-4d61-8a9f-1046f3ffd838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:05.963869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f31b2-8101-4d61-8a9f-1046f3ffd838 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:05.976554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 361/723] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:05.982455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:05.991979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:06.137642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcfbb0-049c-45cf-a255-751a46e97fc9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:06.179418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2454-a745-480e-aa91-04f499ace312 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.180363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2454-a745-480e-aa91-04f499ace312 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.180874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea2454-a745-480e-aa91-04f499ace312 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.186175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 362/724] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:06.187581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025cea2-bd2f-43cf-a7cc-b7dfb448ad42 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.187859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025cea2-bd2f-43cf-a7cc-b7dfb448ad42 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.188191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025cea2-bd2f-43cf-a7cc-b7dfb448ad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.189936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:06.190626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.190626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.190626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.202624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:06.204126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:06.221707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:06.222856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:06.223779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:06.223779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:06.223779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:06.223779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 363/725] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:06.228938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:06.232467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a025cea2-bd2f-43cf-a7cc-b7dfb448ad42 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:06.235642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a025cea2-bd2f-43cf-a7cc-b7dfb448ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:06.344686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:06.390248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 363/726] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:06.429837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44fb65-412f-473b-a805-c50d593e6e16 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:06.438934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cccdb-4ed0-440b-916a-ae000edd51b9 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.439218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cccdb-4ed0-440b-916a-ae000edd51b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.439492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cccdb-4ed0-440b-916a-ae000edd51b9 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.441250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 364/727] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:06.447044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a486-5544-496d-9190-208347b193d8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.447318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a486-5544-496d-9190-208347b193d8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.447588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a486-5544-496d-9190-208347b193d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.470227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a221a486-5544-496d-9190-208347b193d8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:06.471982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a221a486-5544-496d-9190-208347b193d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:06.487891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:06.507789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:06.508340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.508621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.509528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.510187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:06.510490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:06.512477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:06.539758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 364/728] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:06.545401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:06.588046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 365/729] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:50:06.590000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50bc0-4538-47f7-acc9-4c25c28d8197 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.590484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50bc0-4538-47f7-acc9-4c25c28d8197 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.590972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50bc0-4538-47f7-acc9-4c25c28d8197 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.596386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 366/730] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:06.597711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e1ad-1e0f-4a87-95ab-9907d6909693 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.598292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e1ad-1e0f-4a87-95ab-9907d6909693 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.598758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e1ad-1e0f-4a87-95ab-9907d6909693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.634317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2753e1ad-1e0f-4a87-95ab-9907d6909693 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:06.635527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2753e1ad-1e0f-4a87-95ab-9907d6909693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:06.693511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb158a0-3cc4-4067-a264-148f390e5f6b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:06.711125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:06.731168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:06.731902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.732247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.732583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.732741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 367/731] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:06.733643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e1ad-1e0f-4a87-95ab-9907d6909693 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:06.740646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:06.742238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:06.757854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:06.758717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:06.759684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 365/732] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:06.765410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:06.909346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:06.917006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e1ad-1e0f-4a87-95ab-9907d6909693 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:06.937026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db90c-9b0b-4f37-8ead-77720d4ed22a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:06.962360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:06.963208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.963632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.963970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.971251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:06.971860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.972131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.972398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.973219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:06.973531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:06.974976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:06.979678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:06.989479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:06.990408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:50:06.991221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:06.991836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 368/733] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:06.993585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:06.999025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 366/734] 10.222.0.89 () {56 vars in 1135 bytes} [Tue Aug 30 00:50:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:06.999873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.045818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.105512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a06d9-704c-416f-b2d6-ef7c8d4928e3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.119927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926608-2585-48fa-b84b-c474c6d16596 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.142064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.142697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.142974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.143242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.145666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.156009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:07.159509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.160233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.160498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.160785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.161479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:07.161774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:07.162514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:07.163412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:07.164220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:07.165558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:07.165629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 369/735] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:07.165629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.183392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 367/736] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:07.183392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.271549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffaa78-e82e-4e32-9f8d-8d598352c983 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.280928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.286916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa642-ea66-4c59-9b73-b20749487747 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.305651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.306264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.306537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.306806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.321156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.321746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.322036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.322299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.322950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.324785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:07.341592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 368/737] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:07 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:07.342504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.375541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.385337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.387953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:07.473852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd5000-f526-4f1f-88ad-5cded1dfea4f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.515425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036988d-eff4-4b13-8af2-a165e0e3e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.516315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036988d-eff4-4b13-8af2-a165e0e3e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.516433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 370/738] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:50:07.516513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036988d-eff4-4b13-8af2-a165e0e3e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.516630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036988d-eff4-4b13-8af2-a165e0e3e8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.516987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.517401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036988d-eff4-4b13-8af2-a165e0e3e8f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:07.517703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036988d-eff4-4b13-8af2-a165e0e3e8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.519226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036988d-eff4-4b13-8af2-a165e0e3e8f6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:07.528708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 369/739] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:07.529926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c525c-f3d7-4d53-82d0-ddbfcf9ede03 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.530209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c525c-f3d7-4d53-82d0-ddbfcf9ede03 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.530479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c525c-f3d7-4d53-82d0-ddbfcf9ede03 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.531679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 370/740] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:07.532365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c525c-f3d7-4d53-82d0-ddbfcf9ede03 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.549911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.631459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.639661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2141-e789-44f1-a1c6-2a18df55c71c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.644675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c525c-f3d7-4d53-82d0-ddbfcf9ede03 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.678609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b12313-9222-4503-9454-9bed0884987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.679647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b12313-9222-4503-9454-9bed0884987c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.680077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b12313-9222-4503-9454-9bed0884987c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.680514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b12313-9222-4503-9454-9bed0884987c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.681351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e2938-b09e-4443-880c-d630b3c18532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.681974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2938-b09e-4443-880c-d630b3c18532 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.682247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2938-b09e-4443-880c-d630b3c18532 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.682511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e2938-b09e-4443-880c-d630b3c18532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.694230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e2938-b09e-4443-880c-d630b3c18532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.695686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e2938-b09e-4443-880c-d630b3c18532 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:07.697122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b12313-9222-4503-9454-9bed0884987c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.699348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b12313-9222-4503-9454-9bed0884987c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ae3e2938-b09e-4443-880c-d630b3c18532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:07.710810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:07.711985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:07.712892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:07.712892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:07.712892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:07.712892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 371/741] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:07.713424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad831-1fd0-457f-98a8-4d6b8dcdffd9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.713704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad831-1fd0-457f-98a8-4d6b8dcdffd9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.713970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ad831-1fd0-457f-98a8-4d6b8dcdffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-35b12313-9222-4503-9454-9bed0884987c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:07.719195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:07.720233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:07.721285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:07.721285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:07.721285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:07.727538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 371/742] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:07.727538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b12313-9222-4503-9454-9bed0884987c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.738237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-641ad831-1fd0-457f-98a8-4d6b8dcdffd9 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:07.739544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-641ad831-1fd0-457f-98a8-4d6b8dcdffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:07.805599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.824826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 372/743] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:50:07.824826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad831-1fd0-457f-98a8-4d6b8dcdffd9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.841511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b12313-9222-4503-9454-9bed0884987c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.887174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.887814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.888085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.888352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.902812 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.904310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:07.913014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:07.923261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:07.924350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:07.925289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:07.925289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:07.925289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:07.925289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 372/744] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:07.925941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:07.948980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ad831-1fd0-457f-98a8-4d6b8dcdffd9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:07.989250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:07.990083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:07.990422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:07.990836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:07.991551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:07.991956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:07.993851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.006879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 373/745] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:08.008055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.053766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cc733-048e-41b6-aea2-cb9580f18e0f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.071282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:08.087954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.088560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.088860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.089163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.089800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:08.090097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.091460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.103730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 373/746] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:08.104672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.122273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928048-5ddf-4266-9e58-22f060b1c60b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.157427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.158021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.158302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.158570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.159210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:08.159507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.160933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.166386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:08.173253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 374/747] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:08.174037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.221273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26158-804d-45bd-8395-6e4f52b3274f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.261726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.262394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.262705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.262988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.270274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.271716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.278068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbe4f-bbab-4095-ad6e-d070b04d9691 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:08.283640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:08.284521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:08.285432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:08.289119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 374/748] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:08.290802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.296380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:08.316126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.316761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.317064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.317334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.324892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.326294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:08.338457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:08.340416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 375/749] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:08.341389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.410883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f18e05-bdc1-49bf-82cf-b83044ce7126 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.428944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:08.445680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.446284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.446579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.446847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.447491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.449015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.462867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06689-c1b0-44a6-99dc-c5f5a2f1c19d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.466739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 375/750] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:08 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:08.467868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.512546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.513274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.513548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.513814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.522873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.524363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:08.537045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:08.538088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:08.539009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 376/751] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:08.539628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.575596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:08.602527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fed6-354a-4d2a-ba44-503d8e6c18aa None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.642062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.642739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.643024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.643295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.644003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:08.644310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.646383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.656689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0675-0fd0-4ac9-8b87-953d21ff6ca8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.658800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 376/752] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:08.659733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.700928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.701826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.702276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.702541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.703310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:08.703613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.705060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.710652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:08.727577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 377/753] 10.222.0.89 () {56 vars in 1149 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:08.728522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.798201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d325-f474-4cbf-b13c-41df68960c35 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.832699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:08.843894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9de63-95ba-4e1a-9550-bf44803fe46e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:08.847677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.848474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.848938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.849356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.850377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:08.850832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.852401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.874805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 377/754] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:08.875902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:08.896069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:08.896692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:08.896996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:08.897515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:08.898251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=c589ae1e5d3843cd92fe1a125990771d) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:08.898552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:08.900630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:08.908664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 378/755] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/role_assignments?user.id=c589ae1e5d3843cd92fe1a125990771d&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:08.909819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.037900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2f718-c609-4914-9d53-0765a1aaa791 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.069427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:09.077733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcaec-5e2d-4564-9ce6-dde29e300234 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.081507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.082304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.082778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.083204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.095996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.097714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:09.113607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:09.114842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:09.115881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:09.115881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:09.115881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:09.116479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.117126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.117400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.117667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.118515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 379/756] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:09.124171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.133881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:09.189442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.191128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.232654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff651c93-46a8-4848-ad88-383215da0031 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.269863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.270465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.270738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.271316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.271734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:09.272031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.273517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.286852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 380/757] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:09.291954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:09.300835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.306052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 378/758] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:09.312871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.366817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:09.404474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e9b2d-91ce-4b1c-ba83-42989ed137ea None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.440924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d946d-4e0f-4827-87d8-8f41a2067153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.441827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d946d-4e0f-4827-87d8-8f41a2067153 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.442104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d946d-4e0f-4827-87d8-8f41a2067153 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.442373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d946d-4e0f-4827-87d8-8f41a2067153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.451207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d946d-4e0f-4827-87d8-8f41a2067153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.453082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d946d-4e0f-4827-87d8-8f41a2067153 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.456370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7c75d-aa77-41ee-a2d1-9b4ff6b4c48f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-481d946d-4e0f-4827-87d8-8f41a2067153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:09.466599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:09.467478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:09.468355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 381/759] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:09.474035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a0ef-6961-45b1-bc72-d68e8b5164cf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.474312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a0ef-6961-45b1-bc72-d68e8b5164cf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.474583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a0ef-6961-45b1-bc72-d68e8b5164cf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.476082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 382/760] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:09.476775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837a0ef-6961-45b1-bc72-d68e8b5164cf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.496607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070866c-26f1-43fd-9746-44937c5b819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.497275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070866c-26f1-43fd-9746-44937c5b819c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.497548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070866c-26f1-43fd-9746-44937c5b819c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.497817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070866c-26f1-43fd-9746-44937c5b819c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.508371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070866c-26f1-43fd-9746-44937c5b819c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.509833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070866c-26f1-43fd-9746-44937c5b819c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a070866c-26f1-43fd-9746-44937c5b819c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:09.525172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:09.527751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:09.529868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:09.529868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:09.529868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:09.529868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 379/761] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:09.529868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15517-8e24-45c3-b4a8-ca8680a6e8ea None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.529868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15517-8e24-45c3-b4a8-ca8680a6e8ea None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.529868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb15517-8e24-45c3-b4a8-ca8680a6e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.547175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cfb15517-8e24-45c3-b4a8-ca8680a6e8ea None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:09.548367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cfb15517-8e24-45c3-b4a8-ca8680a6e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:09.589829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837a0ef-6961-45b1-bc72-d68e8b5164cf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.601174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:09.616282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:09.619173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 380/762] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:09.621159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb15517-8e24-45c3-b4a8-ca8680a6e8ea None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.627433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.628053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.628331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.632818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.632818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:09.633884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.636004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.662766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 383/763] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:09.668453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.806558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb15517-8e24-45c3-b4a8-ca8680a6e8ea None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.846275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.846897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.847222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.847503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.848152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:09.848454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.849861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.871635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 381/764] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:09.874537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2e37-4b2e-4354-9dfc-b8ef60dfb716 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:09.876723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:09.941832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:09.942493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:09.942764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:09.943028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/e9a6ec078043424aa591043afcc32c3a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:09.944971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=e9a6ec078043424aa591043afcc32c3a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:09.946130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:09.947618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:09.965480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 384/765] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:50:09 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/e9a6ec078043424aa591043afcc32c3a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:50:09.966630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:10.023075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95c793-aa0e-4163-a184-bfc83d23bddc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:10.032296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:10.064853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:10.065575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.065857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.066129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.074751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:10.076361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:10.089449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:10.090456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:10.091322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 382/766] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:10.097188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:10.098043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977ab1-8cd6-43d1-b0d5-f833194aec91 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:10.150073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:10.150696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.150971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.151237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.151940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:10.153596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:10.182439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:10.184884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:10.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 385/767] 10.222.0.89 () {56 vars in 1129 bytes} [Tue Aug 30 00:50:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:10.194700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:10.241475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:10.245539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3b52c-eb2d-4e50-85ee-280eefcf22a1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:10.284075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:10.284515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.284792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.285101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.285828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:10.286078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:10.287518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:10.304620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 383/768] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:10.310358 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:10.334133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479739-4947-4dfd-be01-0d91e4421668 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:10.345994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:10.394558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:10.395648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.396128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.396597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.397467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:10.397986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:10.399614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:10.409348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 386/769] 10.222.0.89 () {56 vars in 1124 bytes} [Tue Aug 30 00:50:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:10.414666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:10.426118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b84bc9-36e8-4849-97ee-d412042432d5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:10.460422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:10.461103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.461402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.461660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.462372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=270eaf34577b45c5a86b999c11d24ab1) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:10.462672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:10.468856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:10.470809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 384/770] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:10 2022] GET /identity/v3/role_assignments?user.id=270eaf34577b45c5a86b999c11d24ab1&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:10.602233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba36cf-f10c-467c-b57d-d737bf864f47 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:10.650478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a2e6f-fde0-4f2c-8194-b9d8ce8b8119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:10.651554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2e6f-fde0-4f2c-8194-b9d8ce8b8119 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.652663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2e6f-fde0-4f2c-8194-b9d8ce8b8119 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.653176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2e6f-fde0-4f2c-8194-b9d8ce8b8119 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.654021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2e6f-fde0-4f2c-8194-b9d8ce8b8119 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:10.654517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2e6f-fde0-4f2c-8194-b9d8ce8b8119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:10.656130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2e6f-fde0-4f2c-8194-b9d8ce8b8119 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:10.662717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 387/771] 10.222.0.89 () {56 vars in 1124 bytes} [Tue Aug 30 00:50:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:10.669941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:10.717950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:10.756732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02c55-8980-4d4d-9d59-a83684b26424 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.757055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02c55-8980-4d4d-9d59-a83684b26424 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.757330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02c55-8980-4d4d-9d59-a83684b26424 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.758942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 388/772] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:10.765542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bd78-5181-4363-9621-89072e148270 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.765912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bd78-5181-4363-9621-89072e148270 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.766191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bd78-5181-4363-9621-89072e148270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.787895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fcc9bd78-5181-4363-9621-89072e148270 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:10.789127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcc9bd78-5181-4363-9621-89072e148270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:10.834660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:10.852637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8af58-296e-40ee-929a-56cfb1ae378d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:10.898007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 389/773] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:10.907355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:10.908225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:10.908704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:10.909215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:10.910151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] RBAC: Adding query filter params (interface=public, service_id=283aa74b76c34385bdb65d9d12781fc3, region_id=RegionOne) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:10.910658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:10.912223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:10.922255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 385/774] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:50:10 2022] GET /identity/v3/endpoints?service_id=283aa74b76c34385bdb65d9d12781fc3&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:10.927965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9bd78-5181-4363-9621-89072e148270 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:11.034729 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9bd78-5181-4363-9621-89072e148270 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:11.076984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b1bd0-5550-4dd1-ba12-a09689556cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:11.077964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1bd0-5550-4dd1-ba12-a09689556cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:11.078487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1bd0-5550-4dd1-ba12-a09689556cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:11.078952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1bd0-5550-4dd1-ba12-a09689556cd6 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:11.079783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b1bd0-5550-4dd1-ba12-a09689556cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:11.081382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b1bd0-5550-4dd1-ba12-a09689556cd6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:11.087207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 390/775] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:10 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:11.278317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:11.352163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8438-5854-42a5-89af-fc71700f727c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:11.352719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8438-5854-42a5-89af-fc71700f727c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:11.352719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8438-5854-42a5-89af-fc71700f727c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:11.354362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 391/776] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:11.360457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe8b7-2561-415e-8cb7-429e4b35293e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:11.360743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe8b7-2561-415e-8cb7-429e4b35293e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:11.361051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe8b7-2561-415e-8cb7-429e4b35293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:11.379350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:11.384038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-492fe8b7-2561-415e-8cb7-429e4b35293e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:11.385299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-492fe8b7-2561-415e-8cb7-429e4b35293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:11.400155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94193b6-0377-4e9e-8b1a-3b0a6d2b5e65 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:11.435730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:11.436547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:11.436845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:11.437219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] PATH_INFO: `/v3/services/network` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:11.437831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:11.439279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:11.449418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:11.459957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:11.461070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:11.461917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 386/777] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:11 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:11.473977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:11.491355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 392/778] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:11.602492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9493556-7fc8-4b21-ae8e-0a1ef48e9958 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:11.637048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:11.637667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:11.637943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:11.638231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:11.638824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:11.639135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:11.640478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:11.645480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 387/779] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:11.650704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fe8b7-2561-415e-8cb7-429e4b35293e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:11.789064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:11.818315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:11.824596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fe8b7-2561-415e-8cb7-429e4b35293e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:11.862391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:11.863321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:11.863802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:11.864274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:11.865152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] RBAC: Adding query filter params (type=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:11.865745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:11.867476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:11.874333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 393/780] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:11.879765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:11.922274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:12.003886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d29f3-5e48-48c6-821f-37f6ca61cf81 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:12.011914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6f3a-17a8-461d-a665-37673b7a57b9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:12.048824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:12.048824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.048824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.048824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.068255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:12.073845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:12.075096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:12.075917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:12.077224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 388/781] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:12.081537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:12.082193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.082428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.082694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.083476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] RBAC: Adding query filter params (interface=public, service_id=f18b03e0138448f4b537c0c4284bd3d8, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:12.083781 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:12.085192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:12.088105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:12.102221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 394/782] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:50:11 2022] GET /identity/v3/endpoints?service_id=f18b03e0138448f4b537c0c4284bd3d8&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:12.107816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:12.249601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:12.272818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:12.293359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7201e-efbd-4406-870e-a5930fb95709 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:12.304892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4244300-a44d-4747-951b-12e392b82672 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:12.339877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:12.340494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.340774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.341075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.341749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:12.342052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:12.343693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:12.352789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 389/783] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:12.359987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:12.380447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:12.381225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.381348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.381619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.382242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:12.383626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:12.393758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 395/784] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:12 2022] GET /identity/v3/services => generated 772 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:12.503137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87ee3-d587-4d45-97f8-a89fe2da09ae None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:12.541358 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3f49-a6bc-4b3d-9cdc-27ace68108b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:12.542096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3f49-a6bc-4b3d-9cdc-27ace68108b3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.543108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3f49-a6bc-4b3d-9cdc-27ace68108b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.543515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3f49-a6bc-4b3d-9cdc-27ace68108b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.546867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:12.555658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe3f49-a6bc-4b3d-9cdc-27ace68108b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:12.557742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe3f49-a6bc-4b3d-9cdc-27ace68108b3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-4bbe3f49-a6bc-4b3d-9cdc-27ace68108b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:12.575587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:12.576588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:12.577581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:12.577581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:12.577581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:12.577581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 390/785] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:12.584113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:12.607694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9681aa-4c80-49cd-8dbf-1050e2d98f2e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.608005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9681aa-4c80-49cd-8dbf-1050e2d98f2e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.608239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9681aa-4c80-49cd-8dbf-1050e2d98f2e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.609876 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 391/786] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:12.615132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595690a5-f17f-4a07-a4e9-3698fb28d0fc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.615444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595690a5-f17f-4a07-a4e9-3698fb28d0fc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.615692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595690a5-f17f-4a07-a4e9-3698fb28d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.638902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-595690a5-f17f-4a07-a4e9-3698fb28d0fc None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:12.640128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-595690a5-f17f-4a07-a4e9-3698fb28d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:12.715631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6c544-104a-4810-8fd3-7429ff916eaf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:12.764843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:12.765793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.766303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.766840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.767710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:12.768214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:12.769886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:12.849073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 392/787] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:12.850678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966779a-72de-42c3-b2aa-b498a9fe9a67 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.850968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966779a-72de-42c3-b2aa-b498a9fe9a67 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.851241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966779a-72de-42c3-b2aa-b498a9fe9a67 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.852913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 393/788] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:12.858375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4030-7621-4fe2-b7ed-e5ea3805d639 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:12.858679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4030-7621-4fe2-b7ed-e5ea3805d639 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:12.858922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4030-7621-4fe2-b7ed-e5ea3805d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:12.893743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8cdb4030-7621-4fe2-b7ed-e5ea3805d639 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:12.898098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8cdb4030-7621-4fe2-b7ed-e5ea3805d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:12.936089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 396/789] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:12.946075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:12.972299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:13.041805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 394/790] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:13.104697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21887ad5-0c76-4727-9a69-aba65391878f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.149415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.150317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.150730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.151126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.161408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:13.163041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:13.177177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4030-7621-4fe2-b7ed-e5ea3805d639 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:13.179347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:13.180646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:13.181836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:13.185019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 397/791] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:13.189781 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.231751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:13.285910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4030-7621-4fe2-b7ed-e5ea3805d639 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.315859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:13.328419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a482b-d757-463e-93c0-a32484401186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.329292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a482b-d757-463e-93c0-a32484401186 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.329570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a482b-d757-463e-93c0-a32484401186 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.331433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a482b-d757-463e-93c0-a32484401186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.351193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a482b-d757-463e-93c0-a32484401186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-949a482b-d757-463e-93c0-a32484401186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:13.356624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:13.357554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:13.358364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:13.364575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 395/792] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:13.372042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b20b1-15af-41cf-a950-ff8be9ed057d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.375789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a482b-d757-463e-93c0-a32484401186 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.447916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.449200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.449487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.449758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.450560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:13.450868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:13.453765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:13.486150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 398/793] 10.222.0.89 () {56 vars in 1135 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:13.491792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.522425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a482b-d757-463e-93c0-a32484401186 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.532862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:13.560531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.561176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.561455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.561725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.562393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:13.562695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:13.564057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:13.577372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 396/794] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:13.577372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.613447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee89542-ecce-4da3-b56b-8dc1af5e1ca8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.645983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:13.652332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fc7e7-c731-490c-94f1-a7687259264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.653114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fc7e7-c731-490c-94f1-a7687259264b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.653376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fc7e7-c731-490c-94f1-a7687259264b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.653708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fc7e7-c731-490c-94f1-a7687259264b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.664900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fc7e7-c731-490c-94f1-a7687259264b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:13.666376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fc7e7-c731-490c-94f1-a7687259264b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e89fc7e7-c731-490c-94f1-a7687259264b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:13.680871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:13.681838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:13.682838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:13.682838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:13.682838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:13.682838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 399/795] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:13.683871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9d4bf-1465-4290-ae18-61f4dbf1e322 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.683871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9d4bf-1465-4290-ae18-61f4dbf1e322 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.683871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9d4bf-1465-4290-ae18-61f4dbf1e322 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.689166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 400/796] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:13.689985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9d4bf-1465-4290-ae18-61f4dbf1e322 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.693286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853e86-a8cc-423e-bd46-b5a4496ddb9f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.730523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.731148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.731423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.731688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.741870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:13.747164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:13.748130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:13.748999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 397/797] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:13.749718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.781701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:13.819151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9d4bf-1465-4290-ae18-61f4dbf1e322 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.855580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839b263-7efb-4875-a4b5-f6b5bd5a9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.856133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839b263-7efb-4875-a4b5-f6b5bd5a9f41 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.856409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839b263-7efb-4875-a4b5-f6b5bd5a9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.856675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839b263-7efb-4875-a4b5-f6b5bd5a9f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.859027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fbe30-6653-49de-8664-b339f0af8cc8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:13.867618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839b263-7efb-4875-a4b5-f6b5bd5a9f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:13.869840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839b263-7efb-4875-a4b5-f6b5bd5a9f41 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4839b263-7efb-4875-a4b5-f6b5bd5a9f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:13.884739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:13.886065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:13.886945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:13.886945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:13.886945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:13.886945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 401/798] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:13.887825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb016e-2d6a-47eb-a9c4-4e1a81f7ed92 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.887825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb016e-2d6a-47eb-a9c4-4e1a81f7ed92 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.887825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb016e-2d6a-47eb-a9c4-4e1a81f7ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.900308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:13.900962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:13.901234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:13.901557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:13.902427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:13.902722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:13.904121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:13.905575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-caeb016e-2d6a-47eb-a9c4-4e1a81f7ed92 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:13.906752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-caeb016e-2d6a-47eb-a9c4-4e1a81f7ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:13.916723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 398/799] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:13.917969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:13.940227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:13.979654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 402/800] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:13.981047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb016e-2d6a-47eb-a9c4-4e1a81f7ed92 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.032988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.046555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8891c-fed7-4668-a0f8-28d963b3c44c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.090089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb016e-2d6a-47eb-a9c4-4e1a81f7ed92 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.091288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.092311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.093650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.094075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.094906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:14.095348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.096886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.109117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 399/801] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:14.110804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.130048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.130915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.131322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.131681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.132523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:14.132980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.134497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.152550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 403/802] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:14.152550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.184286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.234432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42122f-b0cf-44be-b196-a4e72ab32b04 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.269748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.270098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288009e-4c5f-4c3b-88bf-0f3b514c9e6a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.270390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.270667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.270933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.278695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.280152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:14.291426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:14.292482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 400/803] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:14.293418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.309587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.310603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.311717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.311999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.312310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.323655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.325300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:14.339966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:14.340972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:14.341885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:14.341885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:14.341885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:14.341885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 404/804] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:14.342854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.405234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65938-6156-49a4-92e0-09221c12eb14 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.429183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.441319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.441952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.442244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.442489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.450330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.451663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.452385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d1860-dc6f-4483-b660-ec40e3bfbc2e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:14.462780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:14.463788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 401/805] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:14.465606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.492735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.493699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.493971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.494222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.494801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.496252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:14.504962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:14.505951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:14.506782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 405/806] 10.222.0.89 () {56 vars in 1129 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:14.507568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.548236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.583213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951065b-24e1-4a7c-96d1-8cc2893eb29f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.610238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a39e5e-35ef-4d38-bfc3-3ea38329e4a4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.618571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.619185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.619465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.619734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.620428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:14.620852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.623036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.640024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 402/807] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:14.640843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.651616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.652316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.652614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.652901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.653543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:14.653837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.655202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.672016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 406/808] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:14.672016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.672016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.746382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682211-b16d-4d51-abc0-42b23103fb3a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.772785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a871-ebe4-41d1-85ab-8aafe41e77b6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.777050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.782783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c4bf3-733f-4a7d-984e-62908142ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.783396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4bf3-733f-4a7d-984e-62908142ac20 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.783672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4bf3-733f-4a7d-984e-62908142ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.784040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4bf3-733f-4a7d-984e-62908142ac20 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.784825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4bf3-733f-4a7d-984e-62908142ac20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:14.785156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4bf3-733f-4a7d-984e-62908142ac20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.786606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4bf3-733f-4a7d-984e-62908142ac20 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.804087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 403/809] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:14.805317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58384bcb-faf7-4c13-885d-fec8a9109a2c None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.805643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58384bcb-faf7-4c13-885d-fec8a9109a2c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.805857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58384bcb-faf7-4c13-885d-fec8a9109a2c None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.806769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.807218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 404/810] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:14.807448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.807778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58384bcb-faf7-4c13-885d-fec8a9109a2c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.807938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.808075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.808738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:14.809070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.810465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.817201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 407/811] 10.222.0.89 () {56 vars in 1124 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:14.817919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.886658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:14.911311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58384bcb-faf7-4c13-885d-fec8a9109a2c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.921724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228de43-0c00-4078-94bc-3a1bad9206d4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:14.946013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca327b-3281-4094-a3e3-da232b82048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.946597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca327b-3281-4094-a3e3-da232b82048f None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.946871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca327b-3281-4094-a3e3-da232b82048f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.947138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca327b-3281-4094-a3e3-da232b82048f None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/c589ae1e5d3843cd92fe1a125990771d/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.949143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca327b-3281-4094-a3e3-da232b82048f None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=c589ae1e5d3843cd92fe1a125990771d, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.950553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca327b-3281-4094-a3e3-da232b82048f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.955080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:14.955685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.955954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.956221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.963272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:14.963646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 405/812] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:50:14 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/c589ae1e5d3843cd92fe1a125990771d/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:50:14.964940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:14.966189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdd88-a7ba-4254-ab18-8e1b5c8c29a2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:14.966912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdd88-a7ba-4254-ab18-8e1b5c8c29a2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:14.967520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bdd88-a7ba-4254-ab18-8e1b5c8c29a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:14.977561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:14.978642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:14.979677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 408/813] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:14.980407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:14.988264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-682bdd88-a7ba-4254-ab18-8e1b5c8c29a2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:14.989549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-682bdd88-a7ba-4254-ab18-8e1b5c8c29a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:15.042943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.073482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 406/814] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:15.073482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdd88-a7ba-4254-ab18-8e1b5c8c29a2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.109499 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81410870-3940-4097-9ec1-c9072e7f8671 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.145182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.155864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.156711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.157426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.157710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.199545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bdd88-a7ba-4254-ab18-8e1b5c8c29a2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.237034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.237921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.238198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.238469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.239519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:15.239844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.241533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.247415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.248337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 407/815] 10.222.0.89 () {56 vars in 1124 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:15.249182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.253433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.313492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.374915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 409/816] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:15.374915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.379037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b529a-e699-43e2-bd33-79ea7eaff150 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.402889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.417811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.418431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.418708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.418979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.419712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:15.420013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.421465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.443129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 408/817] 10.222.0.89 () {56 vars in 1149 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:15.444051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.489669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0facf1d-8553-4e1a-a73f-c565f6ce0ddf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.526369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.527661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.528047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.528558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.529749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.531258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.547861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7a0a2-f46c-4cf1-9fa3-9f791677f5e1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.549433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.564848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 410/818] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:15.564848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.598037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.598809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.599157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.599499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] PATH_INFO: `/v3/services/network` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.600158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.601659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:15.612189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:15.613315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:50:15.614149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:15.619043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 409/819] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:15.620254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.692426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.717257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cdd14-cd4a-4486-a2b4-382162e514cf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.739835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f6a8-cbd3-4514-a81c-342b75cae287 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.764977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.765597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.765939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.766207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.778007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.779445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.785126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.785765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.786039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.786309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:15.796447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:15.797621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:15.798910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:15.798910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:15.798910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:15.798910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 411/820] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:15.799154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.801949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.802810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:15.818301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:15.819307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:15.820829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:15.820829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:15.820829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:15.820829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 410/821] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:15.820829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.837265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.925972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4360b2-2a29-45af-aae3-52fb4fb880c8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.930047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674ff2-ae79-4e79-a6f9-ba7e3113f2b1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:15.966526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.967546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.968004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.968455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.969346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:15.969658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.971033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.976385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:15.977316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:15.977790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:15.978827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:15.979706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:15.980730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:15.982611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:15.983906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 411/822] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:15.984349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:15.984860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:15.992251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 412/823] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:15.993860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.070957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:16.100823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f310d40-a086-4116-9464-c0ee2274c1ef None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.136925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6335d-10ba-4566-958a-8223452799f1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.144050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.145020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.145501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.145998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.146867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:16.147364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.148964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.163458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 412/824] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:16.164708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.176021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.176669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.177028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.177573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.185027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.186504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:16.198430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:16.199430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 413/825] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:16.200961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.265938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:16.278734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74890db-0640-47e7-81a6-800e4007962e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.311294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281eb0d7-39c4-400e-a410-15244e463ac2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.315472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.316341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.316829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.317349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.318188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] RBAC: Adding query filter params (type=network) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:16.318774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.320322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.326468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 413/826] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:16.327653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.333147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:16.347360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.347998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.348324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.348601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.356187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.357679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:16.370727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:16.371672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:16.372542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:16.376848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 414/827] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:16.377753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.441603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5626b-3b60-4325-a181-4c0e8b0dc64e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.477963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.478939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.479549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.480103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.481199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:16.481732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.483352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.483560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45152e4e-dbce-4154-9e7d-f8a08d93e8ca None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.497206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 414/828] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:16.498518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.502407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:16.525411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.526006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.526456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.527306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.528012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.529865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.561886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 415/829] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:16.562749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.572406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:16.631892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7219cce-099e-426d-ace2-29894b2a5a60 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.693759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.694658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.695083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.695496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.697457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:16.697937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.700411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.733810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 415/830] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:16.739809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:16.774387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6819d5-b25f-47d6-bc6f-a42be3676620 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.815958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8ec62-8145-4178-a7ed-2b5a394c03ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.816842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8ec62-8145-4178-a7ed-2b5a394c03ba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.817269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8ec62-8145-4178-a7ed-2b5a394c03ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.817743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8ec62-8145-4178-a7ed-2b5a394c03ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.819291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8ec62-8145-4178-a7ed-2b5a394c03ba None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=e9a6ec078043424aa591043afcc32c3a) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:16.819756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8ec62-8145-4178-a7ed-2b5a394c03ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.821755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8ec62-8145-4178-a7ed-2b5a394c03ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.829669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 416/831] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:16 2022] GET /identity/v3/role_assignments?user.id=e9a6ec078043424aa591043afcc32c3a&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:16.882033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997878e5-5b95-42ba-8369-edb935b458a2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:16.908871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:16.925146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f5e05-fbda-483e-84a1-7fcec53222b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:16.925827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5e05-fbda-483e-84a1-7fcec53222b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:16.926100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5e05-fbda-483e-84a1-7fcec53222b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:16.926369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5e05-fbda-483e-84a1-7fcec53222b1 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/270eaf34577b45c5a86b999c11d24ab1/roles/33333e39653f4ee589cbae8b5422ddc8` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:16.943130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f5e05-fbda-483e-84a1-7fcec53222b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=270eaf34577b45c5a86b999c11d24ab1, role_id=33333e39653f4ee589cbae8b5422ddc8)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:16.944571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f5e05-fbda-483e-84a1-7fcec53222b1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:16.960977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 416/832] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:50:16 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/270eaf34577b45c5a86b999c11d24ab1/roles/33333e39653f4ee589cbae8b5422ddc8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:50:17.036438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf469-5e36-4f99-90d0-0f5def2e541a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:17.037168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf469-5e36-4f99-90d0-0f5def2e541a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:17.037606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf469-5e36-4f99-90d0-0f5def2e541a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:17.039141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 417/833] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:17.045378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e88a4-44a3-400b-9a2c-aa3bc8b3bf54 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:17.045658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e88a4-44a3-400b-9a2c-aa3bc8b3bf54 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:17.045929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e88a4-44a3-400b-9a2c-aa3bc8b3bf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:17.065893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-315e88a4-44a3-400b-9a2c-aa3bc8b3bf54 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:17.067216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-315e88a4-44a3-400b-9a2c-aa3bc8b3bf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:17.142127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 417/834] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:17.410046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cf469-5e36-4f99-90d0-0f5def2e541a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:17.454453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:17.518217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cf469-5e36-4f99-90d0-0f5def2e541a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:17.552313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:17.552972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:17.553245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:17.553509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:17.565500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:17.570311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:17.571234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:17.572074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 418/835] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:17.577614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e88a4-44a3-400b-9a2c-aa3bc8b3bf54 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:17.673091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:17.679369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e88a4-44a3-400b-9a2c-aa3bc8b3bf54 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:17.718585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698da15-9144-41bf-924a-be45b9361202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:17.719215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698da15-9144-41bf-924a-be45b9361202 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:17.719488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698da15-9144-41bf-924a-be45b9361202 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:17.719751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698da15-9144-41bf-924a-be45b9361202 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:17.720436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698da15-9144-41bf-924a-be45b9361202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:17.720724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698da15-9144-41bf-924a-be45b9361202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:17.722170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698da15-9144-41bf-924a-be45b9361202 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:17.731168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 418/836] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:17.737096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:17.737819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dde29-1f5a-48a5-bc27-0231d41d8b7c None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:17.738118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dde29-1f5a-48a5-bc27-0231d41d8b7c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:17.738403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dde29-1f5a-48a5-bc27-0231d41d8b7c None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:17.739962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 419/837] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:17.748218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58d64-be85-40d0-ba7c-286c0734d700 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:17.748218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58d64-be85-40d0-ba7c-286c0734d700 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:17.748218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58d64-be85-40d0-ba7c-286c0734d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:17.774273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f7f58d64-be85-40d0-ba7c-286c0734d700 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:17.775710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f7f58d64-be85-40d0-ba7c-286c0734d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:17.852028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:17.856350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdc332-939d-4308-a2a4-0a0ab12c196b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:17.861807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 420/838] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:17.899221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:17.899863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:17.900186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:17.900454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:17.911817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:17.913437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:17.928351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:17.929322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:17.930422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:17.930422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:17.930422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:17.930422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 419/839] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:17.937263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f58d64-be85-40d0-ba7c-286c0734d700 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.030847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:18.043309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f58d64-be85-40d0-ba7c-286c0734d700 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:18.080310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:18.080989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.081344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.081620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.082312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:18.082618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:18.083976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:18.100446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 421/840] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:18.106043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.133225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.229169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684566-689a-4bf8-9a33-b30b46437462 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:18.265175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:18.266150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.266561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b8b6b-7e0f-4d9a-addf-08611f748164 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:18.266895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.267352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.276202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:18.278042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:18.292133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:18.293154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:50:18.294581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:18.302594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 420/841] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:18.304511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.306999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:18.307950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.308531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.309044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.309837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:18.311382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:18.318668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:18.322193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:18.323851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:18.324684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:18.327576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 422/842] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:18.336123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.357152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:18.430193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d471-d232-45dd-bd9b-aa4ca44bf98d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:18.441029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e4501-a0e9-46c3-bd45-e6e15a9ef134 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:18.476280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:18.476938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.477228 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.477500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.478248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:18.478551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:18.480149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:18.480682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:18.481646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.482114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.482657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.483474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:18.483968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:18.485543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:18.496150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 423/843] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:18.498166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.500109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 421/844] 10.222.0.89 () {56 vars in 1135 bytes} [Tue Aug 30 00:50:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:18.505584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.591774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:18.601410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:18.625139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8340b-ae51-4865-a644-480bc834b1a9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:18.654726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a388a-045d-41e6-835b-ca16248e5ff0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:18.665847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:18.666883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.667547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.668163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.669056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:18.669560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:18.671161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:18.681127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 424/845] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:18.695946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a133968-63e2-4ab4-b132-b7269c1e4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:18.696583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a133968-63e2-4ab4-b132-b7269c1e4b95 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.696891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a133968-63e2-4ab4-b132-b7269c1e4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.697165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a133968-63e2-4ab4-b132-b7269c1e4b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.778068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a133968-63e2-4ab4-b132-b7269c1e4b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:18.779580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a133968-63e2-4ab4-b132-b7269c1e4b95 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:18.854593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:18.893987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 422/846] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:50:18.899585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:18.961064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdae5-bd8a-4e0d-ab9a-092dabea962c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.961398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdae5-bd8a-4e0d-ab9a-092dabea962c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.961612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdae5-bd8a-4e0d-ab9a-092dabea962c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.963217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 423/847] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:18.968460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fd1c3-772b-4e4c-9edc-6d7ae753f2ee None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:18.968743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fd1c3-772b-4e4c-9edc-6d7ae753f2ee None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:18.969050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fd1c3-772b-4e4c-9edc-6d7ae753f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:18.988149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-058fd1c3-772b-4e4c-9edc-6d7ae753f2ee None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:18.989380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-058fd1c3-772b-4e4c-9edc-6d7ae753f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:19.004483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d28400-f021-4eee-a4f5-792e77b4d59a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.042258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.043313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.043896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.044173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.051455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:19.056554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.058074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.061016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 424/848] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:19.062426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba425-f48d-4098-b222-8d08ef05a342 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.062710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba425-f48d-4098-b222-8d08ef05a342 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.062978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba425-f48d-4098-b222-8d08ef05a342 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.064320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 425/849] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:19.072977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da07d-6d48-493d-ba13-688caae45651 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.072977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da07d-6d48-493d-ba13-688caae45651 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.072977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da07d-6d48-493d-ba13-688caae45651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:19.078299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:19.079235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:19.080128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:19.080128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:19.080128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:19.084338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 425/850] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:19.085304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.092860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-af1da07d-6d48-493d-ba13-688caae45651 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:19.094427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-af1da07d-6d48-493d-ba13-688caae45651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:19.181159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 426/851] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:19.192771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2179f0-0701-4222-a279-ec0c3221ca29 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.230226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.231236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.231707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.232170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.233205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:19.233792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.235366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.252233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 426/852] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:19.257644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1da07d-6d48-493d-ba13-688caae45651 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.296216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:19.325701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.372617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1da07d-6d48-493d-ba13-688caae45651 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.386843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:19.416410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.417985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.418364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.418943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.427582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.429682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.437196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c27098-f9b4-442a-94f7-5e712f71ba0b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:19.444177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:19.445069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:19.446488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 427/853] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:19.451845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.478701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.479384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.479655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.479919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.480499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.481905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:19.490609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:19.491567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:19.492433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 427/854] 10.222.0.89 () {56 vars in 1132 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:19.493624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.550182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:19.565167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501bc9-4ca9-4dfe-b5c7-691bb68d567c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.600395 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.600988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0f15-9079-4ef8-adc2-b0599c4cc5bc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.601444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.601444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.601863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.602205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:19.602508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.603939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.616316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 428/855] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:19.617158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.623283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:19.645215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.645827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.646099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.646365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.657003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:19.662970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:19.663899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:19.664757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 428/856] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:19.665967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.732739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f49e75-6465-4c54-9b1f-ac74c64e969a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.769292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.769899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.770174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.770437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.771140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:19.771426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.772786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.777303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0721e-4c1c-4d28-84f8-6937b71a9927 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.781032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 429/857] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:19.781032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.798170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:19.816217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.816932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.817309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.817675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.818510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=c589ae1e5d3843cd92fe1a125990771d) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:19.818909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.820441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.836840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 429/858] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/role_assignments?user.id=c589ae1e5d3843cd92fe1a125990771d&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:19.836840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:19.887756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:19.921245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc0114-80af-4273-9475-cfe6e13424f7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.964892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:19.965642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:19.966056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:19.966379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:19.967255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:19.967620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:19.969133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:19.977869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd68020-97a8-4bb3-9015-42ad0fe8f88c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:19.979419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 430/859] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:19.986366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:20.026170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:20.027119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.027491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.027767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.028433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:20.028933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:20.031189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:20.038503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 430/860] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:20.088410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:20.120170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f6bee-ca83-4af3-b23b-3b63a0267cb1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:20.161239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:20.161906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.162178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.162440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.174971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:20.176553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:20.192496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:20.193544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:20.194414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:20.194414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:20.194414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:20.194414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 431/861] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:20.201306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:20.308732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646d2a-389f-48d1-9bca-99b82ecd0d0b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:20.310349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:20.344318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:20.344898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.345177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.345446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.346106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:20.346404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:20.347762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:20.360075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 431/862] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:20.365927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:20.473565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389b92a-4aed-47c6-848a-7a3d723b1fa5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:20.504715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:20.514196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb02953-32bf-4294-9bbf-ac70837b7ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:20.514832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb02953-32bf-4294-9bbf-ac70837b7ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.515107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb02953-32bf-4294-9bbf-ac70837b7ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.515377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb02953-32bf-4294-9bbf-ac70837b7ce3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.523353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb02953-32bf-4294-9bbf-ac70837b7ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:20.524830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb02953-32bf-4294-9bbf-ac70837b7ce3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-deb02953-32bf-4294-9bbf-ac70837b7ce3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:20.539412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:20.540426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:20.541371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 432/863] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:50:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:20.548342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:20.662443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa738c-08fb-49e0-9e7b-cc3a0cf347db None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:20.693143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c40cc-69bd-4c36-b57b-b1b13f572219 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.694250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c40cc-69bd-4c36-b57b-b1b13f572219 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.695097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c40cc-69bd-4c36-b57b-b1b13f572219 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.697501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 433/864] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:20.700942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:20.701819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.702282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.702737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.703659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:20.704152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:20.704385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63cd5-e6b1-426b-8bf7-ac0eefc7ec61 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.704665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63cd5-e6b1-426b-8bf7-ac0eefc7ec61 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.704960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63cd5-e6b1-426b-8bf7-ac0eefc7ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.706470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:20.724396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-afc63cd5-e6b1-426b-8bf7-ac0eefc7ec61 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:20.725547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-afc63cd5-e6b1-426b-8bf7-ac0eefc7ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:20.727146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 432/865] 10.222.0.89 () {56 vars in 1149 bytes} [Tue Aug 30 00:50:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:20.733099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:20.756902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:20.813210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 434/866] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:20.837249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598229b7-7b55-4d24-9d16-74cb7af3275e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:20.872965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:20.873603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:20.873870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:20.874129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:20.942515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:20.943862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:20.965940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:21.051143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 433/867] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:50:21.056846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc63cd5-e6b1-426b-8bf7-ac0eefc7ec61 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:21.123610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:21.165565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc63cd5-e6b1-426b-8bf7-ac0eefc7ec61 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:21.185595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:21.206811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:21.207811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.208314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.208862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.220849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:21.222675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:21.234996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccc4fc-0f77-47c2-8c2f-8bcc6d384d30 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:21.239477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:21.240409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:21.241445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:21.241445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:21.241445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:21.243958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 435/868] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:21.252478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:21.267908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:21.271324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:21.272066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.272350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.272622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.273440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:21.274905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:21.293590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 434/869] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:21 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:21.374519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d152-44ca-4769-928b-4ecd52b80105 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:21.421409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:21.422215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.422489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.422753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.423506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:21.423798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:21.425250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:21.439698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 436/870] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:21.445569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:21.552975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cbaf3-2b57-463e-90aa-05eff6d6b940 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:21.588475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:21.589513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.590150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.590427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.598154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:21.599690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:21.612002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:21.613010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:21.613923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 435/871] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:21.619955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:21.649224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:21.725083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55852d3-3eda-4a65-a754-28ccc5acae85 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:21.764300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d2279-1002-426f-9d2e-1e6dca7696e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:21.764946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d2279-1002-426f-9d2e-1e6dca7696e9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.765222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d2279-1002-426f-9d2e-1e6dca7696e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.765485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d2279-1002-426f-9d2e-1e6dca7696e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.766229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d2279-1002-426f-9d2e-1e6dca7696e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:21.766528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d2279-1002-426f-9d2e-1e6dca7696e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:21.768001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d2279-1002-426f-9d2e-1e6dca7696e9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:21.780581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 437/872] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:21.786510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:21.833267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:21.891073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad33f0-1896-40cc-b735-ef9586c435ed None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:21.926169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042c7ec-f4e1-45fa-a3b6-15fee359aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:21.926779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c7ec-f4e1-45fa-a3b6-15fee359aa54 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.927047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c7ec-f4e1-45fa-a3b6-15fee359aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.927314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c7ec-f4e1-45fa-a3b6-15fee359aa54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.928042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042c7ec-f4e1-45fa-a3b6-15fee359aa54 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=270eaf34577b45c5a86b999c11d24ab1) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:21.928347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042c7ec-f4e1-45fa-a3b6-15fee359aa54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:21.929850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042c7ec-f4e1-45fa-a3b6-15fee359aa54 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:21.932588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ecda-b822-4353-9fa0-74a6eac91da9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.932891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ecda-b822-4353-9fa0-74a6eac91da9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.933642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ecda-b822-4353-9fa0-74a6eac91da9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.935507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 438/873] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:21.936659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 436/874] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:21 2022] GET /identity/v3/role_assignments?user.id=270eaf34577b45c5a86b999c11d24ab1&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:21.941994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f6db-50c6-4372-b18c-e2f2706be2b1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:21.942273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f6db-50c6-4372-b18c-e2f2706be2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:21.942545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f6db-50c6-4372-b18c-e2f2706be2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:21.962315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-def3f6db-50c6-4372-b18c-e2f2706be2b1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:21.963829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-def3f6db-50c6-4372-b18c-e2f2706be2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:22.042406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 439/875] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:22.080733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815f846-f347-44f2-a63e-4518895b20d4 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:22.081410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815f846-f347-44f2-a63e-4518895b20d4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:22.081891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815f846-f347-44f2-a63e-4518895b20d4 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:22.083852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 437/876] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:22.090146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbbb7d-5d7c-41e0-97b8-d2855ad1cc52 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:22.090751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbbb7d-5d7c-41e0-97b8-d2855ad1cc52 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:22.091226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbbb7d-5d7c-41e0-97b8-d2855ad1cc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:22.111458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b1bbbb7d-5d7c-41e0-97b8-d2855ad1cc52 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:22.112779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1bbbb7d-5d7c-41e0-97b8-d2855ad1cc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:22.123123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:22.184392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 440/877] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:22.310913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815f846-f347-44f2-a63e-4518895b20d4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:22.420458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815f846-f347-44f2-a63e-4518895b20d4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:22.422914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:22.458071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbbb7d-5d7c-41e0-97b8-d2855ad1cc52 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:22.462970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:22.463830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:22.464250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:22.464679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:22.465443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:22.466967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:22.479783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:22.480978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:22.481792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:22.482525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 438/878] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:22.488239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:22.583448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbbb7d-5d7c-41e0-97b8-d2855ad1cc52 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:22.616437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795579-0ec6-4ee6-9a0d-9aae1e6681d5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:22.623564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:22.624432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:22.624977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:22.625500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:22.626348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:22.628465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:22.649621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 441/879] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:22 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:22.671197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb869e-e166-47d9-a239-471e0332278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:22.672245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb869e-e166-47d9-a239-471e0332278a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:22.672723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb869e-e166-47d9-a239-471e0332278a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:22.673238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb869e-e166-47d9-a239-471e0332278a None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:22.674095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb869e-e166-47d9-a239-471e0332278a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:22.674672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb869e-e166-47d9-a239-471e0332278a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:22.676346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb869e-e166-47d9-a239-471e0332278a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:22.683171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 439/880] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:22.689240 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:22.694622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:22.822503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e2952-997b-4465-bf4b-3fabbecbfdc7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:22.858892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cdb5b-7ab4-44ad-9922-d30913ff9b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:22.859507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cdb5b-7ab4-44ad-9922-d30913ff9b17 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:22.859850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cdb5b-7ab4-44ad-9922-d30913ff9b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:22.860117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cdb5b-7ab4-44ad-9922-d30913ff9b17 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:22.860758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cdb5b-7ab4-44ad-9922-d30913ff9b17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:22.861081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cdb5b-7ab4-44ad-9922-d30913ff9b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:22.862438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cdb5b-7ab4-44ad-9922-d30913ff9b17 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:22.868486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 442/881] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:23.365558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5036d33-3c68-495f-a9bf-30e20afab269 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:23.366090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5036d33-3c68-495f-a9bf-30e20afab269 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:23.366090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5036d33-3c68-495f-a9bf-30e20afab269 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:23.367686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 440/882] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:23.373379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af28b6-e499-45be-a090-c2c7a359132e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:23.373666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af28b6-e499-45be-a090-c2c7a359132e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:23.373939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af28b6-e499-45be-a090-c2c7a359132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:23.392794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c9af28b6-e499-45be-a090-c2c7a359132e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:23.394029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c9af28b6-e499-45be-a090-c2c7a359132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:23.458798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:23.465813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 443/883] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:23.747932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5036d33-3c68-495f-a9bf-30e20afab269 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:23.780132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:23.858979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5036d33-3c68-495f-a9bf-30e20afab269 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:23.896219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8d00-6e57-4468-9036-4f76c63f5606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:23.896873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8d00-6e57-4468-9036-4f76c63f5606 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:23.897150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8d00-6e57-4468-9036-4f76c63f5606 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:23.897415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8d00-6e57-4468-9036-4f76c63f5606 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:23.897993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8d00-6e57-4468-9036-4f76c63f5606 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:23.899342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8d00-6e57-4468-9036-4f76c63f5606 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c04a8d00-6e57-4468-9036-4f76c63f5606 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:23.908279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:23.909271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:23.910104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 441/884] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:23.917311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af28b6-e499-45be-a090-c2c7a359132e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:23.953276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4039b8-16f8-4713-99b4-78005f3f3659 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:23.953595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4039b8-16f8-4713-99b4-78005f3f3659 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:23.953819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4039b8-16f8-4713-99b4-78005f3f3659 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:23.955416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 442/885] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:23.960374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf34e4-dd3e-4e51-b498-a0f653463640 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:23.960652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf34e4-dd3e-4e51-b498-a0f653463640 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:23.960971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf34e4-dd3e-4e51-b498-a0f653463640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:23.980759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0cdf34e4-dd3e-4e51-b498-a0f653463640 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:23.982143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0cdf34e4-dd3e-4e51-b498-a0f653463640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:24.033886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af28b6-e499-45be-a090-c2c7a359132e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:24.066277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 443/886] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:24.069222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:24.069832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.070105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.070373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.071013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:24.071309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:24.072673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:24.078164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 444/887] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:24.083893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf34e4-dd3e-4e51-b498-a0f653463640 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:24.108907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:24.188456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf34e4-dd3e-4e51-b498-a0f653463640 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:24.225150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:24.226149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.226703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.227192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.228069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:24.228569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:24.230286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:24.236019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 444/888] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:24.242313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:24.306635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:24.348258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae3ac-c19a-4b32-90c0-799f8e30477e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:24.366135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:24.384636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:24.385338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.385667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.385948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.386669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] RBAC: Adding query filter params (interface=public, service_id=13955140559b4b3487ef6b51b2c96ee3, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:24.386974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:24.388625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:24.394338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 445/889] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:50:24 2022] GET /identity/v3/endpoints?service_id=13955140559b4b3487ef6b51b2c96ee3&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:24.399911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:24.459507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:24.476044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c4355-003e-44ad-915d-16c8af771624 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:24.509881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f188d-893e-4095-80c2-8b7a7f34d5d4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:24.511745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:24.512624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.513171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.513450 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.524548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:24.529955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:24.530861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:24.533508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 445/890] 10.222.0.89 () {56 vars in 1120 bytes} [Tue Aug 30 00:50:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:24.537449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:24.543744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:24.554540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:24.555503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.555986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.556433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.557365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:24.559141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:24.572983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 446/891] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:24 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:50:24.650478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d96662-5a3d-4ea6-850f-20a2c1eff36e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:24.688026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b697a8-5386-4b5e-b1d5-2038e48346ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:24.688646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b697a8-5386-4b5e-b1d5-2038e48346ad None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.688954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b697a8-5386-4b5e-b1d5-2038e48346ad None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.689223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b697a8-5386-4b5e-b1d5-2038e48346ad None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.689903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b697a8-5386-4b5e-b1d5-2038e48346ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:24.690198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b697a8-5386-4b5e-b1d5-2038e48346ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:24.691574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b697a8-5386-4b5e-b1d5-2038e48346ad None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:24.705927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 446/892] 10.222.0.89 () {56 vars in 1115 bytes} [Tue Aug 30 00:50:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:24.707946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:24.811369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c3a9-fbc5-4852-8b6e-6c23089a3cc7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.811552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c3a9-fbc5-4852-8b6e-6c23089a3cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.811815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c3a9-fbc5-4852-8b6e-6c23089a3cc7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.813359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 447/893] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:24.814213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719a3f-896a-4b71-a060-9785a84a3404 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.814484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719a3f-896a-4b71-a060-9785a84a3404 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.814751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719a3f-896a-4b71-a060-9785a84a3404 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.815895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 448/894] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:24.821246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475d5c8-ca95-4c6b-b32a-4d59a845735b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.821526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475d5c8-ca95-4c6b-b32a-4d59a845735b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.821796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475d5c8-ca95-4c6b-b32a-4d59a845735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.827524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f6bdd-3a99-4829-9b65-b6e74da030b1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:24.840100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e475d5c8-ca95-4c6b-b32a-4d59a845735b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:24.841308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e475d5c8-ca95-4c6b-b32a-4d59a845735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:24.843358 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:24.868209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa6595-d467-4eb3-be7f-1762e33946b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:24.868866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6595-d467-4eb3-be7f-1762e33946b2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.869264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6595-d467-4eb3-be7f-1762e33946b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.869579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa6595-d467-4eb3-be7f-1762e33946b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.882443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa6595-d467-4eb3-be7f-1762e33946b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:24.884305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa6595-d467-4eb3-be7f-1762e33946b2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6daa6595-d467-4eb3-be7f-1762e33946b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:24.901261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:24.902275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:24.903149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:24.903149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:24.903149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:24.903149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 447/895] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:24.903915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3d473-09de-43f8-aca7-1946e2b005c6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:24.903915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3d473-09de-43f8-aca7-1946e2b005c6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:24.904075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3d473-09de-43f8-aca7-1946e2b005c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:24.920862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 449/896] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:24.920862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475d5c8-ca95-4c6b-b32a-4d59a845735b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:24.929907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1ec3d473-09de-43f8-aca7-1946e2b005c6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:24.932035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ec3d473-09de-43f8-aca7-1946e2b005c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:24.976114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:25.016833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 448/897] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:25.037810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475d5c8-ca95-4c6b-b32a-4d59a845735b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.073209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.074262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.074712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.075171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.076015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:25.076583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.078173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.090576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 450/898] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:25.096909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:25.098214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3d473-09de-43f8-aca7-1946e2b005c6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.182268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.212754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3d473-09de-43f8-aca7-1946e2b005c6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.258504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.259546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.259825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.260338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.270586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.272055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:25.288063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:25.289110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:25.290072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 449/899] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:25.296621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.312236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e0e63-1fca-44c8-991d-ebd2b3d6ed44 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.334093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:25.357003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.358288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.358791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.359290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.360227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.363211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.382230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 451/900] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:25 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:50:25.389947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.431999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8733-0ea9-4d94-b2e9-58cdca7432d5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.468531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:25.491339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.492281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.492703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.493872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.494878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:25.495684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.497658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.521334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90391186-5988-46ec-bfec-9144b3f8ab25 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.522925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 450/901] 10.222.0.89 () {56 vars in 1149 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:25.529294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.570618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.571450 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.571825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.572099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.572719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.574665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:25.587804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:25.588883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:25.595091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 452/902] 10.222.0.89 () {56 vars in 1132 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:25.597775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.640029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:25.659337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed785-e7aa-4e69-9bcb-7bf96182a8aa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.708991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.709972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.710250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.710521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.728742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1924a-dbf9-4fc5-9016-bf57f0da2f2a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.762274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:25.777183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.777808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.778086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.778361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.779003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:25.779302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.780667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.791357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 453/903] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:25.791690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.811856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.814196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.903740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683db4-9f74-4926-8f27-af1fa654dbbf None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:25.930859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:25.940795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:25.941496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:25.941718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:25.941988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:25.942625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:25.942930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:25.944343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:25.953464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 451/904] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:25.956966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 454/905] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:25.959927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:25.961571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:26.017374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:26.084632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5820dd-6ba3-41c9-bfb7-a890a31d61c8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:26.089557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7677f-fdfd-4db9-a69d-402ccf024b4f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:26.122413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:26.123399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.123863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.124331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.125253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] RBAC: Adding query filter params (interface=public, service_id=93771bbb21f14be193e1fc1bb03b44c6, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:26.125761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:26.127332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:26.131885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:26.132591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.132957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.133286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.138934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 452/906] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/endpoints?service_id=93771bbb21f14be193e1fc1bb03b44c6&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:26.140504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:26.145202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:26.150673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:26.170645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:26.171879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:26.173095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:26.173095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:26.173095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:26.174850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 455/907] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:26.180376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:26.201361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:26.267667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543b27c-cc07-409f-87d2-06272928759e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:26.296437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e9f6-292b-44a4-89e0-37a24d5f7843 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:26.298441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:26.304557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:26.305230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.305504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.305769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.306394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:26.308291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:26.321277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 453/908] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:26 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:50:26.339145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:26.340180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.340728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.341228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.342121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:26.343153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:26.344787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:26.361349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 456/909] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:26.370638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:26.482792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ef757-fa43-4ca3-890a-4060e99c6958 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:26.500439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:26.527702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a03f5-676e-4650-a0d0-cfb4886e38d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:26.528348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a03f5-676e-4650-a0d0-cfb4886e38d0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.528619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a03f5-676e-4650-a0d0-cfb4886e38d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.528919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a03f5-676e-4650-a0d0-cfb4886e38d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.536607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a03f5-676e-4650-a0d0-cfb4886e38d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:26.538144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a03f5-676e-4650-a0d0-cfb4886e38d0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-496a03f5-676e-4650-a0d0-cfb4886e38d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:26.550269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:26.551212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:26.552094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 454/910] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:26.559692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:26.665957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a144026-086b-40e4-8d35-e5ef74dc8e61 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:26.671942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb27ce-84ca-40c9-8e55-0d8bd89cf69a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.672229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb27ce-84ca-40c9-8e55-0d8bd89cf69a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.672508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb27ce-84ca-40c9-8e55-0d8bd89cf69a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.674237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 455/911] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:26.679298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581bc23-9306-4f4d-883b-bb9c761b4587 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.679574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581bc23-9306-4f4d-883b-bb9c761b4587 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.679844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581bc23-9306-4f4d-883b-bb9c761b4587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.699372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3581bc23-9306-4f4d-883b-bb9c761b4587 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:26.700578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3581bc23-9306-4f4d-883b-bb9c761b4587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:26.702399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:26.703066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.703338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.703613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.704342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:26.704639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:26.706078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:26.718810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 457/912] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:26.724552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:26.763183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:26.792793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 456/913] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:26.850516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805f3e0-4b40-443c-91e2-3f5c898de081 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:26.888764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:26.889821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:26.890351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:26.890860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:26.891813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] RBAC: Adding query filter params (role.id=5479b14ccd7d4dfe8e09caa97ffded9e, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=270eaf34577b45c5a86b999c11d24ab1) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:26.892316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:26.894246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:26.900861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 458/914] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:26 2022] GET /identity/v3/role_assignments?user.id=270eaf34577b45c5a86b999c11d24ab1&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=5479b14ccd7d4dfe8e09caa97ffded9e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:27.055801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581bc23-9306-4f4d-883b-bb9c761b4587 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:27.158203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581bc23-9306-4f4d-883b-bb9c761b4587 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:27.160662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:27.194502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b93033-dd9a-4e10-842a-8b1fea1da62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:27.195152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93033-dd9a-4e10-842a-8b1fea1da62b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:27.195433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93033-dd9a-4e10-842a-8b1fea1da62b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:27.195699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93033-dd9a-4e10-842a-8b1fea1da62b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:27.196297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b93033-dd9a-4e10-842a-8b1fea1da62b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:27.197756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b93033-dd9a-4e10-842a-8b1fea1da62b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-75b93033-dd9a-4e10-842a-8b1fea1da62b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:27.207346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:27.209493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:27.210378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 457/915] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:27.215542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:27.309232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:27.325413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898efc09-f843-42eb-aa7b-3c786969e969 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:27.361923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eedb1b-94ab-4090-a127-96e0a529a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:27.362550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eedb1b-94ab-4090-a127-96e0a529a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:27.362830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eedb1b-94ab-4090-a127-96e0a529a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:27.363211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eedb1b-94ab-4090-a127-96e0a529a8a6 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:27.363995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eedb1b-94ab-4090-a127-96e0a529a8a6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:27.364295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eedb1b-94ab-4090-a127-96e0a529a8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:27.365917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eedb1b-94ab-4090-a127-96e0a529a8a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:27.367676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd127-63a6-43f8-b680-ffe2e316a36c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:27.368263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd127-63a6-43f8-b680-ffe2e316a36c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:27.368534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd127-63a6-43f8-b680-ffe2e316a36c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:27.372533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 459/917] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:27.372679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 458/917] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:27.375983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8375-825d-4f35-b1a9-6a90912a0aa3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:27.376269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8375-825d-4f35-b1a9-6a90912a0aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:27.376539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8375-825d-4f35-b1a9-6a90912a0aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:27.379397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cd127-63a6-43f8-b680-ffe2e316a36c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:27.396952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-56be8375-825d-4f35-b1a9-6a90912a0aa3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:27.398172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-56be8375-825d-4f35-b1a9-6a90912a0aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:27.483762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 460/918] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:27.507317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cd127-63a6-43f8-b680-ffe2e316a36c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:27.543363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050d30-da48-48e4-a990-66301f36254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:27.543975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050d30-da48-48e4-a990-66301f36254b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:27.544254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050d30-da48-48e4-a990-66301f36254b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:27.544581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050d30-da48-48e4-a990-66301f36254b None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:27.545258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050d30-da48-48e4-a990-66301f36254b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:27.545603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050d30-da48-48e4-a990-66301f36254b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:27.546990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050d30-da48-48e4-a990-66301f36254b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:27.553034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 459/919] 10.222.0.89 () {56 vars in 1114 bytes} [Tue Aug 30 00:50:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:27.559597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be8375-825d-4f35-b1a9-6a90912a0aa3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:27.644882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:27.663864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be8375-825d-4f35-b1a9-6a90912a0aa3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:27.697833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:27.698436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:27.698707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:27.698974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:27.699640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:27.701016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:27.728993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 461/920] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:27.767130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050d30-da48-48e4-a990-66301f36254b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:27.805968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:27.887600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050d30-da48-48e4-a990-66301f36254b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:27.928585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:27.929248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:27.929523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:27.929790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:27.930372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:27.931743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:27.941526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:27.942578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:27.943617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 460/921] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:27.948708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:28.068636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9d712-8bae-4c13-ae7c-905ada75ab7b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:28.114721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:28.118223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:28.118513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:28.118757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:28.120886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:28.121221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:28.125907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:28.128669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:28.133723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 462/922] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:28.141242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:28.255143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:28.264996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f03da0-d963-4c9a-b86c-165e897864b6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:28.306635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:28.307340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:28.307642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:28.308005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:28.308654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:28.309002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:28.310425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:28.316192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 461/923] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:28.322244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:28.447427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead4ba6-b609-4879-ad29-fde5789b862f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:28.493473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78871236-add3-4a52-8c82-3ced000bc593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:28.494941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871236-add3-4a52-8c82-3ced000bc593 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:28.495606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871236-add3-4a52-8c82-3ced000bc593 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:28.496236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871236-add3-4a52-8c82-3ced000bc593 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:28.497618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871236-add3-4a52-8c82-3ced000bc593 None admin] RBAC: Adding query filter params (interface=public, service_id=ca122ddc8ec245138a1db0f1b1797076, region_id=RegionOne) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:28.498363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871236-add3-4a52-8c82-3ced000bc593 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:28.500038 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871236-add3-4a52-8c82-3ced000bc593 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:28.506707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 463/924] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:50:28 2022] GET /identity/v3/endpoints?service_id=ca122ddc8ec245138a1db0f1b1797076&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:28.512537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:28.548340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d58b-019c-4cd8-b8eb-e2c8a18a0e00 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:28.548619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d58b-019c-4cd8-b8eb-e2c8a18a0e00 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:28.548939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d58b-019c-4cd8-b8eb-e2c8a18a0e00 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:28.550566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 464/925] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:28.555704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb61a-90a4-443f-951a-69be3ca6a2dd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:28.556071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb61a-90a4-443f-951a-69be3ca6a2dd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:28.556260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eb61a-90a4-443f-951a-69be3ca6a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:28.579425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-738eb61a-90a4-443f-951a-69be3ca6a2dd None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:28.580677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-738eb61a-90a4-443f-951a-69be3ca6a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:28.642811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3076324-68cf-444b-960e-9c250d04888e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:28.664688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:28.678771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 465/926] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:28.701654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912354ba-e549-46af-8483-8a6c75144964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:28.702580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912354ba-e549-46af-8483-8a6c75144964 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:28.703003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912354ba-e549-46af-8483-8a6c75144964 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:28.703453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912354ba-e549-46af-8483-8a6c75144964 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:28.704218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912354ba-e549-46af-8483-8a6c75144964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:28.705833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912354ba-e549-46af-8483-8a6c75144964 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:28.712857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 462/927] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:28 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:50:28.975919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eb61a-90a4-443f-951a-69be3ca6a2dd None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:29.068536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2de4-f8fb-47a8-8235-1c82f1a06e1c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.068945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2de4-f8fb-47a8-8235-1c82f1a06e1c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.069134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b2de4-f8fb-47a8-8235-1c82f1a06e1c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.071786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 463/928] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:29.076193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a92eb-28cf-4d8e-8b61-0bddc785de98 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.076550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a92eb-28cf-4d8e-8b61-0bddc785de98 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.076730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a92eb-28cf-4d8e-8b61-0bddc785de98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.107975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d90a92eb-28cf-4d8e-8b61-0bddc785de98 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:29.109604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d90a92eb-28cf-4d8e-8b61-0bddc785de98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:29.112142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eb61a-90a4-443f-951a-69be3ca6a2dd None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:29.129351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:29.154436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:29.155541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.156133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.156610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.157491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:29.159175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:29.171224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:29.172259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:50:29.173198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:29.181736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 466/929] 10.222.0.89 () {56 vars in 1132 bytes} [Tue Aug 30 00:50:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:29.183321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:29.205789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 464/930] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:29.252619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:29.297528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b20402-0575-4dc2-81f3-ec994bb74ca6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:29.332363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:29.333514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.334056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.334540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.335421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:29.335914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:29.337518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:29.343662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 467/931] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:29.349801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a92eb-28cf-4d8e-8b61-0bddc785de98 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:29.465673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a92eb-28cf-4d8e-8b61-0bddc785de98 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:29.472334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:29.504755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:29.505411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.505686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.505972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.506593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:29.506884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:29.508375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:29.514509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 465/932] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:29.521174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:29.542007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:29.591586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f762f9-8182-4c3d-a54c-c4840ff6f9a0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:29.621389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:29.637567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:29.638224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.638500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.638776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.641282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1617-cd52-4738-b58d-e32bfa014d22 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:29.651912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:29.659032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:29.659996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:29.666565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 468/933] 10.222.0.89 () {56 vars in 1120 bytes} [Tue Aug 30 00:50:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:29.669113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:29.682185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:29.683276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.683865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.684325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.685258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:29.687001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:29.711898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 466/934] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:29.786755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f72a-0443-4e83-bb37-baf4399fe013 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:29.833021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9153a-4ee7-4655-a1a8-c2520e2de6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:29.833646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9153a-4ee7-4655-a1a8-c2520e2de6cf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.834095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9153a-4ee7-4655-a1a8-c2520e2de6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.834370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9153a-4ee7-4655-a1a8-c2520e2de6cf None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.835055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9153a-4ee7-4655-a1a8-c2520e2de6cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:29.835357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9153a-4ee7-4655-a1a8-c2520e2de6cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:29.836768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9153a-4ee7-4655-a1a8-c2520e2de6cf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:29.847390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 469/935] 10.222.0.89 () {56 vars in 1115 bytes} [Tue Aug 30 00:50:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:29.853316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:29.905546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e1cc-b725-4533-9d97-5cfb375563e5 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.905872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e1cc-b725-4533-9d97-5cfb375563e5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.906096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e1cc-b725-4533-9d97-5cfb375563e5 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.907452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 470/936] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:29.912659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651bb5f-a10c-419e-a30b-ee65193741eb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:29.912973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651bb5f-a10c-419e-a30b-ee65193741eb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:29.913251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651bb5f-a10c-419e-a30b-ee65193741eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:29.936323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a651bb5f-a10c-419e-a30b-ee65193741eb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:29.937544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a651bb5f-a10c-419e-a30b-ee65193741eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:29.939603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:29.974070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b0b1-bd43-4156-a051-e9ea9db7069f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:29.979821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:30.019361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 471/937] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:30.020442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.021324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.021744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.022135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.033793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.035593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:30.050504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:30.051659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:30.052675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:30.052675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:30.052675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:30.058662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 467/938] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:30.060879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651bb5f-a10c-419e-a30b-ee65193741eb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.164211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651bb5f-a10c-419e-a30b-ee65193741eb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:30.200727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.201610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.202035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.202458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.203243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:30.203696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.205227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.220996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 472/939] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:30.224287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.305785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.339828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:30.342383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c0ea-25a4-4dee-be3f-1a1ac2eca0d4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:30.375451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:30.392921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.394048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.394331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.394605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.405978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.407823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.418696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b05fa-9937-480a-ae9f-9191de90830b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:30.424182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:30.425359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:30.426612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 468/940] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:50:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:30.433689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.460344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.461207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.461483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.462053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.462722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.464247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.467836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING keystone.server.flask.common [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 00:50:30.491488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.sql.core [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:50:30.491488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:50:30.491488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [parameters: {'id': 'a12b550d21374fd2a0c4acc5a6cbc3e7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:50:30.491488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81473) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a12b550d21374fd2a0c4acc5a6cbc3e7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a12b550d21374fd2a0c4acc5a6cbc3e7. Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:50:30.514723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result.read() Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 00:50:30.516210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application yield resource Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise self.value Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application session.commit() Aug 30 00:50:30.517617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:50:30.518688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:50:30.519771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result.read() Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:50:30.528887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [parameters: {'id': 'a12b550d21374fd2a0c4acc5a6cbc3e7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.529897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:30.530698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a12b550d21374fd2a0c4acc5a6cbc3e7. Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 473/941] 10.222.0.89 () {60 vars in 1140 bytes} [Tue Aug 30 00:50:30 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:30.531633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.568160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530f78e-f2d0-4544-8b56-2ce3b2560cd7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:30.613905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.614526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.614803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.615071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.615810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:30.616168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.617985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.637047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 469/942] 10.222.0.89 () {56 vars in 1149 bytes} [Tue Aug 30 00:50:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:30.642699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.645906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:30.664634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4b262-757b-4b60-aab4-3756bb462ad6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:30.688590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:30.709783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.711143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.711637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.712114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.719902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.721873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:30.734069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:30.734986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:30.735861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:30.738247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 474/943] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:30.744942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.755913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3fa0-135c-4bfa-80e0-d56d5bf07e3c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:30.798439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b34d4-df89-4701-b134-15429989327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.799143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b34d4-df89-4701-b134-15429989327e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.799415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b34d4-df89-4701-b134-15429989327e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.799683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b34d4-df89-4701-b134-15429989327e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.814802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b34d4-df89-4701-b134-15429989327e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.817034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b34d4-df89-4701-b134-15429989327e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-836b34d4-df89-4701-b134-15429989327e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:30.835859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:30.837033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:30.838069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:30.838069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:30.838069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:30.838069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 470/944] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:30.839006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f00be-59ac-480f-aea8-e36c670bd19d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.839357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f00be-59ac-480f-aea8-e36c670bd19d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.839746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f00be-59ac-480f-aea8-e36c670bd19d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.841259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 471/945] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:30.843943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f00be-59ac-480f-aea8-e36c670bd19d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:30.872401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c80bd0-3c2a-4627-aadf-a6fc83b28d39 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:30.908879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0a7b0-2df9-4721-bf86-2c6139cfa370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:30.909501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a7b0-2df9-4721-bf86-2c6139cfa370 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.909782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a7b0-2df9-4721-bf86-2c6139cfa370 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.910049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a7b0-2df9-4721-bf86-2c6139cfa370 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.910736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0a7b0-2df9-4721-bf86-2c6139cfa370 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:30.911043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0a7b0-2df9-4721-bf86-2c6139cfa370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:30.912767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0a7b0-2df9-4721-bf86-2c6139cfa370 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:30.937543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 475/946] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:30.939337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8d02d-8bdb-4a09-8dec-57131a006a88 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:30.939618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8d02d-8bdb-4a09-8dec-57131a006a88 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:30.939894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8d02d-8bdb-4a09-8dec-57131a006a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:30.954181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:30.956845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:30.964288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9ae8d02d-8bdb-4a09-8dec-57131a006a88 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:30.966103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9ae8d02d-8bdb-4a09-8dec-57131a006a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:30.969887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f00be-59ac-480f-aea8-e36c670bd19d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:31.010622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:31.011720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.012204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.012667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.013625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:31.014129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:31.015834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:31.029930 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 472/947] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:31.035955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:31.043692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 476/948] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:31.144495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337e262-f366-4625-beea-aad18b733da3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:31.180585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:31.181230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.181501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.181787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.189131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:31.190688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:31.202751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:31.203703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:31.204602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 473/949] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:31.210700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8d02d-8bdb-4a09-8dec-57131a006a88 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:31.313438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:31.318394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8d02d-8bdb-4a09-8dec-57131a006a88 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:31.330836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:31.359506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:31.360208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.360532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.360828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.361538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:31.361883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:31.363935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:31.368373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:31.384041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 477/950] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:31.390303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:31.431608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bb7e5-ff2b-45ed-9447-abed0151c82f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:31.468006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:31.468790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.469201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.469567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.470301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:31.471792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:31.481600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:31.482851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:31.484521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:31.485687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 474/951] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:31.492502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:31.518627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2940-72fe-4d2a-8d96-f7ba13c88d4c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:31.555399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:31.555902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.556087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.556358 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/270eaf34577b45c5a86b999c11d24ab1/roles/5479b14ccd7d4dfe8e09caa97ffded9e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.558844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=270eaf34577b45c5a86b999c11d24ab1, role_id=5479b14ccd7d4dfe8e09caa97ffded9e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:31.560471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:31.578262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 478/952] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:50:31 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/270eaf34577b45c5a86b999c11d24ab1/roles/5479b14ccd7d4dfe8e09caa97ffded9e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:50:31.603746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:31.633084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21201d-3eec-4e6d-b81b-39c4f1b5eb50 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:31.672831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54633d1-5ebc-4048-b1ee-b771ca1801eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:31.673747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54633d1-5ebc-4048-b1ee-b771ca1801eb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.674215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54633d1-5ebc-4048-b1ee-b771ca1801eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.674625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54633d1-5ebc-4048-b1ee-b771ca1801eb None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.675427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54633d1-5ebc-4048-b1ee-b771ca1801eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:31.675886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54633d1-5ebc-4048-b1ee-b771ca1801eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:31.677540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54633d1-5ebc-4048-b1ee-b771ca1801eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:31.688741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 475/953] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:31.690474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:31.759367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:31.798516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf828e0-5172-4d4a-80af-e287ed3a235b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.799384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf828e0-5172-4d4a-80af-e287ed3a235b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.799893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf828e0-5172-4d4a-80af-e287ed3a235b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.803642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 476/954] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:31.808229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76d57-7041-4ef7-b083-222266a665e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.808748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76d57-7041-4ef7-b083-222266a665e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.809279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76d57-7041-4ef7-b083-222266a665e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.817732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00c40b-4bd5-46d8-b6e9-fd109426a400 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:31.828997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-67e76d57-7041-4ef7-b083-222266a665e1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:31.830498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-67e76d57-7041-4ef7-b083-222266a665e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:31.852599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:31.853567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:31.853567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:31.853885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:31.854492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:31.854789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:31.856146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:31.866128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 479/955] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:31.868066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:31.928825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 477/956] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:31.985976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61521-9968-4026-9ce1-26aafc18ca9d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:32.006624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:32.021679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:32.022293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:32.022568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:32.022832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:32.023495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:32.024899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:32.049276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 480/957] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:50:32.209404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76d57-7041-4ef7-b083-222266a665e1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:32.284587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:32.317768 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76d57-7041-4ef7-b083-222266a665e1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:32.358747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:32.359378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:32.359788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:32.360060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:32.360662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:32.362128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:32.371698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:32.372780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:32.374362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 478/958] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:32.379296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:32.487672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36886c59-9359-4a28-9d03-ad2b1726ad35 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:32.523063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe9b7-a4eb-463b-ac86-a2dd3f5d2710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:32.523699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe9b7-a4eb-463b-ac86-a2dd3f5d2710 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:32.524018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe9b7-a4eb-463b-ac86-a2dd3f5d2710 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:32.524295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe9b7-a4eb-463b-ac86-a2dd3f5d2710 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:32.524970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fe9b7-a4eb-463b-ac86-a2dd3f5d2710 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:32.525265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fe9b7-a4eb-463b-ac86-a2dd3f5d2710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:32.526847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fe9b7-a4eb-463b-ac86-a2dd3f5d2710 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:32.532070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 481/959] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:32.538025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:32.646348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98388-cdb0-4b3d-a2e4-d73efe478209 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:32.676086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:32.684258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef621-bae1-4c05-bb95-7b2775231ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:32.685164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef621-bae1-4c05-bb95-7b2775231ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:32.685647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef621-bae1-4c05-bb95-7b2775231ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:32.686088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef621-bae1-4c05-bb95-7b2775231ad3 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:32.686899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef621-bae1-4c05-bb95-7b2775231ad3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:32.687367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef621-bae1-4c05-bb95-7b2775231ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:32.688935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef621-bae1-4c05-bb95-7b2775231ad3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:32.694366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 479/960] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:33.022715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2c90d-f653-48c1-aba6-e8407484a985 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:33.023262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2c90d-f653-48c1-aba6-e8407484a985 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:33.023262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2c90d-f653-48c1-aba6-e8407484a985 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:33.024919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 482/961] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:33.030314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fcb85-89b1-49af-8cde-3dbbcc57f005 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:33.030591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fcb85-89b1-49af-8cde-3dbbcc57f005 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:33.030859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fcb85-89b1-49af-8cde-3dbbcc57f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:33.049716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4a4fcb85-89b1-49af-8cde-3dbbcc57f005 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:33.050898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4a4fcb85-89b1-49af-8cde-3dbbcc57f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:33.120000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 480/962] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:33.385116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2c90d-f653-48c1-aba6-e8407484a985 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:33.428847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:33.488523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2c90d-f653-48c1-aba6-e8407484a985 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:33.523150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:33.523766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:33.524040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:33.524309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:33.524988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:33.526566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:33.542488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.sql.core [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:50:33.542488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:50:33.542488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [parameters: {'user_id': '7811729c684e4647a72bef1e865f7101', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:50:33.542488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81473) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-97448f03-b799-4f02-9dde-616087a9d68f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result.read() Aug 30 00:50:33.550126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:50:33.550987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application yield resource Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise self.value Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application session.commit() Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:50:33.552061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:50:33.553129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:50:33.554011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result.read() Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:50:33.554901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [parameters: {'user_id': '7811729c684e4647a72bef1e865f7101', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:33.555730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 00:50:33.558531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 00:50:33.561893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 00:50:33.561893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 00:50:33.561893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:50:33.561893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:50:33.561893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:50:33.561893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:33.561893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 483/963] 10.222.0.89 () {60 vars in 1131 bytes} [Tue Aug 30 00:50:33 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:33.562842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fcb85-89b1-49af-8cde-3dbbcc57f005 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:33.580680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605eb15-7200-4868-8186-8d55f73bb0d6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:33.580991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605eb15-7200-4868-8186-8d55f73bb0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:33.581263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605eb15-7200-4868-8186-8d55f73bb0d6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:33.586123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 484/964] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:33.591828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b7af-f372-47cd-8f98-0c8a10b67cb9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:33.592119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b7af-f372-47cd-8f98-0c8a10b67cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:33.592374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b7af-f372-47cd-8f98-0c8a10b67cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:33.616890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d1a9b7af-f372-47cd-8f98-0c8a10b67cb9 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:33.619815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d1a9b7af-f372-47cd-8f98-0c8a10b67cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:33.677555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fcb85-89b1-49af-8cde-3dbbcc57f005 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:33.706391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:33.720850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 485/965] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:33.722548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:33.723203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:33.723483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:33.723755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:33.731707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:33.733204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:33.755325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:33.756275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:33.757245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 481/966] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:33.762741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b7af-f372-47cd-8f98-0c8a10b67cb9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:33.796534 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:33.872500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b7af-f372-47cd-8f98-0c8a10b67cb9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:33.909476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3756af-5c95-495d-a1d7-9113fa7ae167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:33.910426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3756af-5c95-495d-a1d7-9113fa7ae167 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:33.910923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3756af-5c95-495d-a1d7-9113fa7ae167 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:33.911384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3756af-5c95-495d-a1d7-9113fa7ae167 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:33.912313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3756af-5c95-495d-a1d7-9113fa7ae167 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:33.912794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3756af-5c95-495d-a1d7-9113fa7ae167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:33.914576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3756af-5c95-495d-a1d7-9113fa7ae167 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:33.952127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 486/967] 10.222.0.89 () {56 vars in 1101 bytes} [Tue Aug 30 00:50:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:34.003617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.118087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd61f-ee67-4a69-b911-c78004bbc4a9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:34.155176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:34.155715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195b22-62e1-4c04-b6b7-cc4c5835658b None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.156180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.156269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195b22-62e1-4c04-b6b7-cc4c5835658b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.156342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.156424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28195b22-62e1-4c04-b6b7-cc4c5835658b None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.156502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.161786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 487/968] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:34.163415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878338bb-7155-4ff8-aafc-c9fe42e61d5b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.163709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878338bb-7155-4ff8-aafc-c9fe42e61d5b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.163986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878338bb-7155-4ff8-aafc-c9fe42e61d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.168375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:34.173942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:34.174952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:34.175819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 482/969] 10.222.0.89 () {56 vars in 1120 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:34.183345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.185220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-878338bb-7155-4ff8-aafc-c9fe42e61d5b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:34.186442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-878338bb-7155-4ff8-aafc-c9fe42e61d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:34.245482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:34.277987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 488/970] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:34.312711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241331b-2c47-4636-af49-8b4bcf682239 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:34.347406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:34.348047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.348296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.348585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.349299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:34.349601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:34.350981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:34.364473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 483/971] 10.222.0.89 () {56 vars in 1115 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:34.365601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878338bb-7155-4ff8-aafc-c9fe42e61d5b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.389590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:34.474726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878338bb-7155-4ff8-aafc-c9fe42e61d5b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:34.510515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:34.511067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.511344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.511616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.521921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:34.523365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:34.537799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:34.538753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:34.539623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:34.539623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:34.539623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:34.539623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 489/972] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:34.545780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.545920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.623161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:34.654809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d1afe-821d-40b9-9a20-c0ede38b3d8b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:34.655164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2c20-5e28-4316-a30e-a0e698ed4d13 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:34.663204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:34.690686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:34.691431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.691781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.692122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.692866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:34.693171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:34.693299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:34.693802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.694077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.694343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.694540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:34.694927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:34.696286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:34.705279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:34.706289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:34.707106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 484/973] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:34.709064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 490/974] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:34.714616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.715808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.820473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214359ab-fdb5-4ed3-b886-f5c0e3456b3b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:34.826514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d13c8-f30d-48d6-8780-241cfdabd3ee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:34.849907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:34.855885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad7689-9af0-4593-9399-8ef3bf67fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:34.856519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad7689-9af0-4593-9399-8ef3bf67fc93 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.856795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad7689-9af0-4593-9399-8ef3bf67fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.857089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad7689-9af0-4593-9399-8ef3bf67fc93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.860428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b5f9d-b7fc-44c2-900f-4a7cd05b44c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:34.861135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5f9d-b7fc-44c2-900f-4a7cd05b44c6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.861411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5f9d-b7fc-44c2-900f-4a7cd05b44c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.861679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5f9d-b7fc-44c2-900f-4a7cd05b44c6 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.862298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b5f9d-b7fc-44c2-900f-4a7cd05b44c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:34.862591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b5f9d-b7fc-44c2-900f-4a7cd05b44c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:34.863967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b5f9d-b7fc-44c2-900f-4a7cd05b44c6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:34.864303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad7689-9af0-4593-9399-8ef3bf67fc93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:34.865753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad7689-9af0-4593-9399-8ef3bf67fc93 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:34.868910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 485/975] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:34.870609 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c7b6-0789-4ddc-9994-a9b49d427e01 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.870890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c7b6-0789-4ddc-9994-a9b49d427e01 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.871161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c7b6-0789-4ddc-9994-a9b49d427e01 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.872833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 486/976] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:34.874700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00c7b6-0789-4ddc-9994-a9b49d427e01 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-62ad7689-9af0-4593-9399-8ef3bf67fc93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:34.878556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:34.879569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:34.880515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 491/977] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:34.881603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef87dcb-def9-47e9-8ab7-75da8c22d26f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:34.881603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef87dcb-def9-47e9-8ab7-75da8c22d26f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:34.881603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef87dcb-def9-47e9-8ab7-75da8c22d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:34.900328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8ef87dcb-def9-47e9-8ab7-75da8c22d26f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:34.901846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8ef87dcb-def9-47e9-8ab7-75da8c22d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:34.910960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:34.971068 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 492/978] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:34.971925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef87dcb-def9-47e9-8ab7-75da8c22d26f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:34.984004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00c7b6-0789-4ddc-9994-a9b49d427e01 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.020835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.021437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.021714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.021975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.022985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:35.023286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.025020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.035365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 487/979] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:35.036977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:35.082735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef87dcb-def9-47e9-8ab7-75da8c22d26f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.108261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:35.121909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.122527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.122806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.123078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.123809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:35.124111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.125566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.143821 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:35.143988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 493/980] 10.222.0.89 () {56 vars in 1149 bytes} [Tue Aug 30 00:50:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:35.148125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bddb9f-7c2a-46bb-ad2e-9cd48fcc9a6a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.149865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:35.185965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.186580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.186863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.187132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.187867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] RBAC: Adding query filter params (interface=admin, service_id=ca122ddc8ec245138a1db0f1b1797076, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:35.188181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.189715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.195360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 488/981] 10.222.0.89 () {56 vars in 1249 bytes} [Tue Aug 30 00:50:35 2022] GET /identity/v3/endpoints?service_id=ca122ddc8ec245138a1db0f1b1797076&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:35.201484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:35.259569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49597eca-4ce0-41f4-b6b2-40b52e239027 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.295369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.296086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.296363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.296633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.304353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8f425-c149-400c-ae32-3aeb711b6489 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.339010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.339537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.339810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.340081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.340679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.342104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.345950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:35.348053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 489/982] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:35 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:50:35.348836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:35.370096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.371605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.388517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:35.477172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10a048-cdce-4f92-b456-98823948c4d7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.490296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 494/983] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:35.496818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:35.522631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.523547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.524044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.524314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.524987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.526414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.557705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 490/984] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:35 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:35.589472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:35.612452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6180534-0186-4aaa-bb9f-ed268bfc7f56 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.661325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.661981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.662258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.662536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.674807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.676293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:35.693583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:35.694615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:35.695522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:35.695522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:35.695522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:35.696276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 495/985] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:35.701216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:35.794628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:35.812320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987765f-cd52-43aa-a4fe-ebb0e2092454 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:35.847200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:35.847732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:35.848003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:35.848268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:35.848947 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:35.849242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:35.850658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:35.863108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 491/986] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:35.868957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:35.973386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c5870-565d-412d-9a87-a08e3417794e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:36.001116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:36.010717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:36.011500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:36.011872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:36.012227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:36.019314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:36.020936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:36.033458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:36.034553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:36.035810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:36.037184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 496/987] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:36.043023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:36.148590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c8c91-c8f8-41e6-94fe-5b2dfcf4a5da None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:36.181913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4cd11-e87f-40bc-aad4-fd65a6b56e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:36.182632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4cd11-e87f-40bc-aad4-fd65a6b56e46 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:36.183015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4cd11-e87f-40bc-aad4-fd65a6b56e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:36.183371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4cd11-e87f-40bc-aad4-fd65a6b56e46 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:36.184171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4cd11-e87f-40bc-aad4-fd65a6b56e46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:36.184569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4cd11-e87f-40bc-aad4-fd65a6b56e46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:36.186133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4cd11-e87f-40bc-aad4-fd65a6b56e46 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:36.202802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 492/988] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:36.204389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:36.311183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8051af-d399-48a4-a532-f1eb995f2762 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:36.345929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd00c2-193d-4ea2-a6c0-b8ce8163d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:36.346550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd00c2-193d-4ea2-a6c0-b8ce8163d96b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:36.346832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd00c2-193d-4ea2-a6c0-b8ce8163d96b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:36.347105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd00c2-193d-4ea2-a6c0-b8ce8163d96b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:36.347835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd00c2-193d-4ea2-a6c0-b8ce8163d96b None admin] RBAC: Adding query filter params (role.id=5479b14ccd7d4dfe8e09caa97ffded9e, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=270eaf34577b45c5a86b999c11d24ab1) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:36.348143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd00c2-193d-4ea2-a6c0-b8ce8163d96b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:36.349598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd00c2-193d-4ea2-a6c0-b8ce8163d96b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:36.364901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 497/989] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:36 2022] GET /identity/v3/role_assignments?user.id=270eaf34577b45c5a86b999c11d24ab1&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=5479b14ccd7d4dfe8e09caa97ffded9e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:37.277400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292122f5-8bfb-41f8-9b99-d6b452604fdf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:37.278011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292122f5-8bfb-41f8-9b99-d6b452604fdf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:37.278011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292122f5-8bfb-41f8-9b99-d6b452604fdf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:37.279264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 493/990] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:37.284874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f20a09-1db4-4bb2-b372-eef20755d41c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:37.285230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f20a09-1db4-4bb2-b372-eef20755d41c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:37.285572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f20a09-1db4-4bb2-b372-eef20755d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:37.304694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f9f20a09-1db4-4bb2-b372-eef20755d41c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:37.305960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f9f20a09-1db4-4bb2-b372-eef20755d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:37.361857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:37.384065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 498/991] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:37.496203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3ecb-ccd5-4917-a217-ad5c452f759d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:37.496503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3ecb-ccd5-4917-a217-ad5c452f759d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:37.496885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c3ecb-ccd5-4917-a217-ad5c452f759d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:37.498501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 494/992] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:37.503665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886e851-b31d-4a6e-855a-5f9dc67d3171 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:37.503957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886e851-b31d-4a6e-855a-5f9dc67d3171 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:37.504229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886e851-b31d-4a6e-855a-5f9dc67d3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:37.523130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2886e851-b31d-4a6e-855a-5f9dc67d3171 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:37.524337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2886e851-b31d-4a6e-855a-5f9dc67d3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:37.595990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 499/993] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:37.648934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3ecb-ccd5-4917-a217-ad5c452f759d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:37.661775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:37.769232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c3ecb-ccd5-4917-a217-ad5c452f759d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:37.803737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:37.804364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:37.804631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:37.804920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:37.805494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:37.806955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:37.816126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:37.817210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:37.822282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 495/994] 10.222.0.89 () {56 vars in 1126 bytes} [Tue Aug 30 00:50:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:37.825210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886e851-b31d-4a6e-855a-5f9dc67d3171 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:37.865703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:37.931027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886e851-b31d-4a6e-855a-5f9dc67d3171 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:37.945010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:37.947742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:37.967071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:37.967683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:37.967956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:37.968222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:37.968881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:37.969296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:37.970536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:37.975480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 500/995] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:37.981578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:37.990423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737a950-8ccf-4c47-bb59-f6f29fdf75c7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.028095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.028838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.029088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.029313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.029892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.031666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:38.040568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:38.041786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:38.042650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 496/996] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:38.047892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:38.090439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e6c32-7650-4376-a83a-d95c7e1266fc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.126328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.126861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.127133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.127405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.128030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:38.128353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.129755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.134953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 501/997] 10.222.0.89 () {56 vars in 1122 bytes} [Tue Aug 30 00:50:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:38.140634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:38.158521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d9251-48fd-4342-9fd7-9cba918b135b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.185194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:38.195124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.195751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.196025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.196289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.196952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:38.197308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.198881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.199974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:38.208830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 497/998] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:38.210515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:38.256977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f679-db83-4a38-a265-b6c4a46476e0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.293966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edebea-9ee6-48e4-935b-a202557f03e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.294578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edebea-9ee6-48e4-935b-a202557f03e7 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.294863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edebea-9ee6-48e4-935b-a202557f03e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.295127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edebea-9ee6-48e4-935b-a202557f03e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.295784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edebea-9ee6-48e4-935b-a202557f03e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.297208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edebea-9ee6-48e4-935b-a202557f03e7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.316307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 502/999] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:50:38.318368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3aea-ff5f-4d00-a77c-6da74b7a8d96 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.318869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3aea-ff5f-4d00-a77c-6da74b7a8d96 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.319015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3aea-ff5f-4d00-a77c-6da74b7a8d96 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.320365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 503/1000] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:38.322049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb284b6e-5ea0-445f-821c-42d7c66199fc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.326226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62b2e-6731-4ebe-98cd-1ff1ecce3b6d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.326538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62b2e-6731-4ebe-98cd-1ff1ecce3b6d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.326857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d62b2e-6731-4ebe-98cd-1ff1ecce3b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.346833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c4d62b2e-6731-4ebe-98cd-1ff1ecce3b6d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:38.348086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c4d62b2e-6731-4ebe-98cd-1ff1ecce3b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:38.372923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.373569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.373854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.374096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.374743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:38.375041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.376530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.387585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 498/1001] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:38.388910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:38.428474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 504/1002] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:38.455752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:38.503358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f33e-d0b1-464f-9251-3e253d88b732 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.538079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.538697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.538972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.539235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.539925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] RBAC: Adding query filter params (interface=public, service_id=0aefbb28e8ee4a3aa2922161f492777e, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:38.540222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.541721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.551226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 499/1003] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:50:38 2022] GET /identity/v3/endpoints?service_id=0aefbb28e8ee4a3aa2922161f492777e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:38.552872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d62b2e-6731-4ebe-98cd-1ff1ecce3b6d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:38.584458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:38.662191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d62b2e-6731-4ebe-98cd-1ff1ecce3b6d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.692296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:38.699300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.699948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.700212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.700476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.701141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.702672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.716838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 505/1004] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:38 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:50:38.822382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66717c2-f314-4f38-a44d-cd24e704e464 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:38.849241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:38.864399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:38.865072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:38.865345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:38.865608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:38.866213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:38.867909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:38.877980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:38.879110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:38.879939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 500/1005] 10.222.0.89 () {56 vars in 1105 bytes} [Tue Aug 30 00:50:38 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:38.885328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:38.982100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:38.989427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c571e9f-5a18-47ec-aa37-27b534092f10 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:39.025554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e82419-acb2-4fdd-bab6-0bb381a8b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:39.026113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82419-acb2-4fdd-bab6-0bb381a8b838 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:39.026359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82419-acb2-4fdd-bab6-0bb381a8b838 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:39.026665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82419-acb2-4fdd-bab6-0bb381a8b838 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:39.027303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e82419-acb2-4fdd-bab6-0bb381a8b838 None admin] RBAC: Adding query filter params (name=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:39.027583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e82419-acb2-4fdd-bab6-0bb381a8b838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:39.029106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e82419-acb2-4fdd-bab6-0bb381a8b838 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:39.038921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 506/1006] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:39.040225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:39.147758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed12818-d843-4750-a864-2cb9f72c4721 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:39.183160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2b19-4373-4a85-a6d9-d3fd551ff150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:39.183776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2b19-4373-4a85-a6d9-d3fd551ff150 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:39.184052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2b19-4373-4a85-a6d9-d3fd551ff150 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:39.184319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2b19-4373-4a85-a6d9-d3fd551ff150 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:39.184991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c2b19-4373-4a85-a6d9-d3fd551ff150 None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:39.185290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c2b19-4373-4a85-a6d9-d3fd551ff150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:39.186720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c2b19-4373-4a85-a6d9-d3fd551ff150 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:39.191802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 501/1007] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:40.255628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb9930-0468-46ed-b9ab-e272de796512 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:40.256176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb9930-0468-46ed-b9ab-e272de796512 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:40.256176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb9930-0468-46ed-b9ab-e272de796512 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:40.257674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 507/1008] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:40.263927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905549-6d1e-404b-b3f9-e0ff6eac309a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:40.264453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905549-6d1e-404b-b3f9-e0ff6eac309a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:40.264453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905549-6d1e-404b-b3f9-e0ff6eac309a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:40.283959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8a905549-6d1e-404b-b3f9-e0ff6eac309a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:40.285255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a905549-6d1e-404b-b3f9-e0ff6eac309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:40.340000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:40.364246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 502/1009] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:40.630129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb9930-0468-46ed-b9ab-e272de796512 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:40.701067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1e28-c68a-4775-8229-2d398ad9a357 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:40.701449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1e28-c68a-4775-8229-2d398ad9a357 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:40.701616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da1e28-c68a-4775-8229-2d398ad9a357 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:40.702999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 503/1010] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:40.709423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03a5e-0c9b-4756-a563-2ef4b61131e6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:40.709700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03a5e-0c9b-4756-a563-2ef4b61131e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:40.709967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03a5e-0c9b-4756-a563-2ef4b61131e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:40.732625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-72e03a5e-0c9b-4756-a563-2ef4b61131e6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:40.734384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-72e03a5e-0c9b-4756-a563-2ef4b61131e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:40.739606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb9930-0468-46ed-b9ab-e272de796512 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:40.779875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:40.780496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:40.780770 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:40.781076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:40.782512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:40.784100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:40.785944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 508/1011] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:40.791744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:40.816628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 504/1012] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:40.823528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:40.900323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a8bf-21a4-45d4-95e9-795d7c5dab7f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:40.935286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edddf69-3013-40dd-b506-1f2b0aaab436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:40.935891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edddf69-3013-40dd-b506-1f2b0aaab436 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:40.936161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edddf69-3013-40dd-b506-1f2b0aaab436 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:40.936427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edddf69-3013-40dd-b506-1f2b0aaab436 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:40.937108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edddf69-3013-40dd-b506-1f2b0aaab436 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:40.938518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edddf69-3013-40dd-b506-1f2b0aaab436 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:40.971489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 509/1013] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:40 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:50:41.077520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ae18-18d6-48f0-950c-a064b5a2e709 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:41.077886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ae18-18d6-48f0-950c-a064b5a2e709 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:41.078052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ae18-18d6-48f0-950c-a064b5a2e709 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:41.079413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 505/1014] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:41.085175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016276b0-c3f4-47ec-82ce-1d92a96603ce None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:41.085459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016276b0-c3f4-47ec-82ce-1d92a96603ce None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:41.085727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016276b0-c3f4-47ec-82ce-1d92a96603ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:41.091528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ae18-18d6-48f0-950c-a064b5a2e709 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:41.107762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-016276b0-c3f4-47ec-82ce-1d92a96603ce None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:41.109003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-016276b0-c3f4-47ec-82ce-1d92a96603ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:41.187808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 510/1015] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:41.216523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ae18-18d6-48f0-950c-a064b5a2e709 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:41.227777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:41.253905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:41.254578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:41.254859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:41.255127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:41.255708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:41.257105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:41.266828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:41.268591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:50:41.269774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:41.272849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 506/1016] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:41.274097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016276b0-c3f4-47ec-82ce-1d92a96603ce None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:41.285364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:41.378262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016276b0-c3f4-47ec-82ce-1d92a96603ce None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:41.413338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:41.413942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:41.414215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:41.414481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:41.415104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:41.415394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:41.417209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:41.426526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 511/1017] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:41.427840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:41.456902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:41.533904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:41.541135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b27d3d-6816-4e3a-a07f-c76899798129 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:41.569793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a5b19-0a02-4145-929b-3ad962a9c83b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:41.577256 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:41.577955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:41.578764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:41.579022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:41.579650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:41.579948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:41.581508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:41.586971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 507/1018] 10.222.0.89 () {56 vars in 1112 bytes} [Tue Aug 30 00:50:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:41.592963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:41.611881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d3ce-dcb8-4997-ad6f-8180dc12ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:41.612468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d3ce-dcb8-4997-ad6f-8180dc12ba4c None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:41.612733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d3ce-dcb8-4997-ad6f-8180dc12ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:41.613108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d3ce-dcb8-4997-ad6f-8180dc12ba4c None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:41.613762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d3ce-dcb8-4997-ad6f-8180dc12ba4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:41.615153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d3ce-dcb8-4997-ad6f-8180dc12ba4c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:41.634342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 512/1019] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:50:41 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:50:41.636565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:41.710755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d67e6-9c0e-49fe-9ca9-68d20b847e62 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:41.762024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697b329-9030-4666-9a2a-f65c33539ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:41.762638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b329-9030-4666-9a2a-f65c33539ae0 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:41.762909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b329-9030-4666-9a2a-f65c33539ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:41.763174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b329-9030-4666-9a2a-f65c33539ae0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:41.763841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697b329-9030-4666-9a2a-f65c33539ae0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:41.765272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697b329-9030-4666-9a2a-f65c33539ae0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:41.789798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 508/1020] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:50:42.918451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f61473-e481-4e25-bfdf-2ed9133cf3fb None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:42.919057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f61473-e481-4e25-bfdf-2ed9133cf3fb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:42.919057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f61473-e481-4e25-bfdf-2ed9133cf3fb None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:42.920514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 513/1021] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:42.925757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0e27-9d82-4a66-8a43-5b5539232fe4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:42.926190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0e27-9d82-4a66-8a43-5b5539232fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:42.926453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b0e27-9d82-4a66-8a43-5b5539232fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:42.946301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bf0b0e27-9d82-4a66-8a43-5b5539232fe4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:42.947630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bf0b0e27-9d82-4a66-8a43-5b5539232fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:43.029860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 509/1022] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:43.295592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f61473-e481-4e25-bfdf-2ed9133cf3fb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:43.404438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f61473-e481-4e25-bfdf-2ed9133cf3fb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:43.439778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:43.448062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962c3d9-fad3-4ee5-80b1-ee710eff2f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:43.448715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c3d9-fad3-4ee5-80b1-ee710eff2f4a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:43.449031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c3d9-fad3-4ee5-80b1-ee710eff2f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:43.449306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c3d9-fad3-4ee5-80b1-ee710eff2f4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:43.450620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962c3d9-fad3-4ee5-80b1-ee710eff2f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:43.452316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962c3d9-fad3-4ee5-80b1-ee710eff2f4a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:43.458599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 514/1023] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:43.460066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0e27-9d82-4a66-8a43-5b5539232fe4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:43.479255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:43.563233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52796fc-ba14-4c10-8d52-cae4240fb09a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:43.563411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52796fc-ba14-4c10-8d52-cae4240fb09a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:43.563708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52796fc-ba14-4c10-8d52-cae4240fb09a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:43.565084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 515/1024] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:43.570030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b0e27-9d82-4a66-8a43-5b5539232fe4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:43.570171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be15996-28a1-4e37-88aa-1b168409e621 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:43.570364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be15996-28a1-4e37-88aa-1b168409e621 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:43.570661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be15996-28a1-4e37-88aa-1b168409e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:43.589184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0be15996-28a1-4e37-88aa-1b168409e621 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:43.590568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0be15996-28a1-4e37-88aa-1b168409e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:43.607284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2054b1-dea0-48c7-a3bc-22d5f6df3bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:43.607882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2054b1-dea0-48c7-a3bc-22d5f6df3bc6 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:43.608163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2054b1-dea0-48c7-a3bc-22d5f6df3bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:43.608434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2054b1-dea0-48c7-a3bc-22d5f6df3bc6 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:43.609131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2054b1-dea0-48c7-a3bc-22d5f6df3bc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:43.610595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2054b1-dea0-48c7-a3bc-22d5f6df3bc6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:43.635848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 510/1025] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:50:43 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:43.665829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 516/1026] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:43.845594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b59a0-9b3c-4e92-8565-bac12256789f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:43.845791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b59a0-9b3c-4e92-8565-bac12256789f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:43.846058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b59a0-9b3c-4e92-8565-bac12256789f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:43.847429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 511/1027] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:43.853025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f70b-6eba-4d72-bfed-11b5d31d2c41 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:43.853543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f70b-6eba-4d72-bfed-11b5d31d2c41 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:43.853855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5f70b-6eba-4d72-bfed-11b5d31d2c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:43.875664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-33d5f70b-6eba-4d72-bfed-11b5d31d2c41 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:43.876959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-33d5f70b-6eba-4d72-bfed-11b5d31d2c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:43.931975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b59a0-9b3c-4e92-8565-bac12256789f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:43.953577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 517/1028] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:44.015916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:44.049523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b59a0-9b3c-4e92-8565-bac12256789f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.084129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.084761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.085066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.085336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.085918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.087307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:44.097082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:44.101109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:44.102046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 512/1029] 10.222.0.89 () {56 vars in 1105 bytes} [Tue Aug 30 00:50:43 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:44.104918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5f70b-6eba-4d72-bfed-11b5d31d2c41 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.169743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:44.214540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5f70b-6eba-4d72-bfed-11b5d31d2c41 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.224889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.249816 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.250440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.250714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.250981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.251630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] RBAC: Adding query filter params (name=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:44.251945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.253357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.261128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 518/1030] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:44.264459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.335598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201bd2e-6263-43c5-bed8-76da6daecec1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.373057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.373613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.373888 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.374155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.375295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ee43-2686-4c48-9c06-eeba21b2ff1d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.377382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:44.387739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:44.392636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:44.393639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:44.394551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 513/1031] 10.222.0.89 () {56 vars in 1120 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:44.399964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.405231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:44.418232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.419018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.419416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.419685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.420568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:44.420896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.422670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.434389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 519/1032] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:44.436043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.512070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a70cb-af3b-41ec-9006-6865316c19f6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.545183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67d8ee-c2c4-4b53-bdfe-d6952a64ccc1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.550548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.551227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.551571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.551908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.552668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:44.553060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.554508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.563802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 514/1033] 10.222.0.89 () {56 vars in 1115 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:44.569592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.583295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.583997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.584346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.584668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.585481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] RBAC: Adding query filter params (interface=public, service_id=23a10c0bc90344f4afbf30afae3f552e, region_id=RegionOne) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:44.585853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.587294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.592836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 520/1034] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/endpoints?service_id=23a10c0bc90344f4afbf30afae3f552e&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:44.598342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.638925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:44.660624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:44.688527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791ea25-910c-4985-acfa-c454446f8216 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.711427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db8e97-d986-4659-bfe0-c8209ce2ea9d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.727449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.728420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.728793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.729090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.740348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.741837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.755181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.755899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.756243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.756576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.757301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.758675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:44.760308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:44.761286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:44.762751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:44.762751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:44.762751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:44.762751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 515/1035] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:44.767302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:44.777420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 521/1036] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:50:44.900413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13588e60-21ff-4f02-a5ea-f475bfb23a52 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:44.911988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:44.939362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:44.939975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:44.940244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:44.940517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:44.941262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:44.941561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:44.942943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:44.955931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 516/1037] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:44.961824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:45.065648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bc7b-3ae6-4fa1-ad4f-cdb05b25b3a6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:45.082776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:45.101405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:45.102049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:45.102319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:45.102592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:45.110059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:45.111534 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:45.123659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:45.124665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:45.130708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 522/1038] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:50:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:45.131323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:45.237652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc65083-9e2c-4ffc-815e-f2af16f96a4e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:45.273036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f1851-c404-4b90-b751-eed1a379dfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:45.273644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1851-c404-4b90-b751-eed1a379dfad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:45.273917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1851-c404-4b90-b751-eed1a379dfad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:45.274185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1851-c404-4b90-b751-eed1a379dfad None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:45.274975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1851-c404-4b90-b751-eed1a379dfad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:45.275387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1851-c404-4b90-b751-eed1a379dfad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:45.277206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1851-c404-4b90-b751-eed1a379dfad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:45.295336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 517/1039] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:50:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:45.301108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:45.406214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138b1df-b526-46b5-9038-b7d32d7fd202 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:45.443777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:45.444564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:45.444988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:45.445359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:45.492265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:45.518539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:45.520606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:45.616420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7377-0527-472b-8820-cce6aa7ec06a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:45.616667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7377-0527-472b-8820-cce6aa7ec06a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:45.616979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7377-0527-472b-8820-cce6aa7ec06a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:45.618760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 518/1040] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:45.623465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 523/1041] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:45.624015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15143be-7398-46e8-a83a-58dbf8fed724 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:45.624286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15143be-7398-46e8-a83a-58dbf8fed724 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:45.624553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15143be-7398-46e8-a83a-58dbf8fed724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:45.629144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:45.643840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b15143be-7398-46e8-a83a-58dbf8fed724 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:45.645182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b15143be-7398-46e8-a83a-58dbf8fed724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:45.669897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:45.709285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:45.719645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 519/1042] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:45.733613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5d7fe-5154-4be6-b70e-51d4313a92fa None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:45.776580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:45.777246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:45.777528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:45.777797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:45.788251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:45.789774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:45.804986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:45.805924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:45.807336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:45.807336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:45.807336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:45.807336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 524/1043] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:45.814069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15143be-7398-46e8-a83a-58dbf8fed724 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:45.918168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15143be-7398-46e8-a83a-58dbf8fed724 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:45.952226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:45.952855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:45.953107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:45.953388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:45.954031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:45.954330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:45.955702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:45.967254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 520/1044] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:45.973111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:45.985216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:46.009850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:46.085419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a4b5e-0fc6-4da1-bb6a-0802343a97b6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:46.098879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367bd3-ff84-4b9c-b75a-fd9504644fa0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:46.112745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:46.122347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:46.122986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.123252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.123536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.130653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:46.132134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:46.137209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:46.138061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.138511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.138971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:46.143523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:46.144588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:46.145530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 525/1045] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:46.150619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:46.157004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:46.162467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:46.163656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:46.164687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:46.169203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 521/1046] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:46.171080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:46.260062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:46.266383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640f144-7e60-40c2-a3c0-1a4c517744db None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:46.283361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1612896-19da-46e0-901a-8dfda6f03480 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:46.302075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:46.302776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.303114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.303441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.304204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:46.304943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:46.306513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:46.318875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:46.319622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.320076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 526/1047] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:46.320206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.320473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.321279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:46.321673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:46.323270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:46.326543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:46.333205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 522/1048] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:46.338899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:46.378885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:46.434335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23e73-1bb5-4f93-b2d5-046836975504 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:46.451531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae5c50-0a72-4eac-9b06-4d7e20bda88f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:46.471256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:46.471872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.472148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.472419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.473204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] RBAC: Adding query filter params (role.id=5479b14ccd7d4dfe8e09caa97ffded9e, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=e9a6ec078043424aa591043afcc32c3a) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:46.473512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:46.474942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:46.480681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 527/1049] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:46 2022] GET /identity/v3/role_assignments?user.id=e9a6ec078043424aa591043afcc32c3a&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=5479b14ccd7d4dfe8e09caa97ffded9e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:46.493037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908cef5-1cc0-4451-b9f4-46edbd33ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:46.493037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908cef5-1cc0-4451-b9f4-46edbd33ad50 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.493037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908cef5-1cc0-4451-b9f4-46edbd33ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.493037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908cef5-1cc0-4451-b9f4-46edbd33ad50 None admin] PATH_INFO: `/v3/users/a68fe5877ff64711a82b983687b3da2e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.503349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:46.507824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908cef5-1cc0-4451-b9f4-46edbd33ad50 None admin] RBAC: Authorizing `identity:get_user(user_id=a68fe5877ff64711a82b983687b3da2e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:46.509873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908cef5-1cc0-4451-b9f4-46edbd33ad50 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:46.518316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:46.520981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 523/1050] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:50:46 2022] GET /identity/v3/users/a68fe5877ff64711a82b983687b3da2e => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:46.635366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb543d-a46f-4679-8e3a-9c216b4496af None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:46.651980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:46.674957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:46.675685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.676035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.676378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.732530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290dce6-c2ca-4da3-b8a1-399629bef21e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.732785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290dce6-c2ca-4da3-b8a1-399629bef21e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.733098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290dce6-c2ca-4da3-b8a1-399629bef21e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.734578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 524/1051] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:46.739395 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb844ac-9eec-4140-b824-1b1c762e37ec None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:46.739698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb844ac-9eec-4140-b824-1b1c762e37ec None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:46.739965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb844ac-9eec-4140-b824-1b1c762e37ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:46.753607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:46.754557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:46.766476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9fb844ac-9eec-4140-b824-1b1c762e37ec None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:46.767934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9fb844ac-9eec-4140-b824-1b1c762e37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:46.849038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 525/1052] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:46.860061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 528/1053] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:46.866071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb844ac-9eec-4140-b824-1b1c762e37ec None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:46.977268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb844ac-9eec-4140-b824-1b1c762e37ec None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:47.004605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:47.013796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:47.014432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:47.014723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:47.014974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:47.016104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] RBAC: Authorizing `identity:get_project(project_id=f6ea2887d10443bb823686fb7798424c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:47.017572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:47.024172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 526/1054] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:50:46 2022] GET /identity/v3/projects/f6ea2887d10443bb823686fb7798424c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:47.025552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:47.040087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:47.122253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:47.131939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310e68b-b693-47da-891a-de2f2699f4ac None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:47.170520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:47.171131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:47.171405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:47.171673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:47.172399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=f6ea2887d10443bb823686fb7798424c, user.id=a68fe5877ff64711a82b983687b3da2e) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:47.172703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:47.174201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:47.179961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 529/1055] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:47 2022] GET /identity/v3/role_assignments?user.id=a68fe5877ff64711a82b983687b3da2e&scope.project.id=f6ea2887d10443bb823686fb7798424c&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:47.242020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a818b-8280-46e6-8a89-a5725941ee30 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:47.283409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:47.284388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:47.284862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:47.285311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:47.286046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:47.287616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:47.298139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:47.299380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:47.301322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 527/1056] 10.222.0.89 () {56 vars in 1105 bytes} [Tue Aug 30 00:50:47 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:47.306283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:47.389580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:47.415728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8834af0-c5b1-44aa-9f96-21932ba23d3d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:47.451917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:47.452597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:47.452900 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:47.453166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:47.453790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] RBAC: Adding query filter params (name=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:47.454094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:47.455436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:47.465524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 530/1057] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:47.466922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:47.529678 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:47.576921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0f16-19e3-4848-bc90-d995916674d3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:47.613057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5143f2a-e1bd-44ee-99d2-926ea24f75c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:47.613666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5143f2a-e1bd-44ee-99d2-926ea24f75c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:47.613946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5143f2a-e1bd-44ee-99d2-926ea24f75c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:47.614216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5143f2a-e1bd-44ee-99d2-926ea24f75c8 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:47.614851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5143f2a-e1bd-44ee-99d2-926ea24f75c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:47.615150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5143f2a-e1bd-44ee-99d2-926ea24f75c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:47.616544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5143f2a-e1bd-44ee-99d2-926ea24f75c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:47.622075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 528/1058] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:47.627893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:47.730715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72894f6-bba3-42ae-b18d-6cd3dfc7b175 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:47.771961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5193-5838-40e7-b907-04baa5d2fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:47.772570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5193-5838-40e7-b907-04baa5d2fe85 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:47.772854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5193-5838-40e7-b907-04baa5d2fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:47.773132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5193-5838-40e7-b907-04baa5d2fe85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:47.773792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5193-5838-40e7-b907-04baa5d2fe85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:47.775193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5193-5838-40e7-b907-04baa5d2fe85 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:47.785485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:47.809282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 531/1059] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:50:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:48.388087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d4613-894e-4b11-b02a-d5196993f70c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:48.388699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d4613-894e-4b11-b02a-d5196993f70c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:48.388699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d4613-894e-4b11-b02a-d5196993f70c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:48.389976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 529/1060] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:48.395549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43eb9-6b23-4029-bf84-466b42332749 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:48.395988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43eb9-6b23-4029-bf84-466b42332749 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:48.396078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43eb9-6b23-4029-bf84-466b42332749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:48.415745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-10f43eb9-6b23-4029-bf84-466b42332749 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:48.417125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-10f43eb9-6b23-4029-bf84-466b42332749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:48.500858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 532/1061] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:48.764233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d4613-894e-4b11-b02a-d5196993f70c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:48.870507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d4613-894e-4b11-b02a-d5196993f70c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:48.893566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:48.904821 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496e1da-b293-4c33-b486-1b92e2c180f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:48.905485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496e1da-b293-4c33-b486-1b92e2c180f1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:48.905757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496e1da-b293-4c33-b486-1b92e2c180f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:48.906019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496e1da-b293-4c33-b486-1b92e2c180f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:48.918342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496e1da-b293-4c33-b486-1b92e2c180f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4496e1da-b293-4c33-b486-1b92e2c180f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:48.923248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:48.924275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:48.925324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 530/1062] 10.222.0.89 () {56 vars in 1120 bytes} [Tue Aug 30 00:50:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:48.934262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f43eb9-6b23-4029-bf84-466b42332749 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.036410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f43eb9-6b23-4029-bf84-466b42332749 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.059554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:49.073160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.074098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.074098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.074368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.075044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:49.075341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:49.075600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34c7af-cf95-4fbd-a48b-04c53827b918 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.075899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34c7af-cf95-4fbd-a48b-04c53827b918 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.076164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34c7af-cf95-4fbd-a48b-04c53827b918 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.076696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:49.078387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 531/1063] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:49.083242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f902b-427f-41d4-b7c2-8cde5e501453 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.083513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f902b-427f-41d4-b7c2-8cde5e501453 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.083797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f902b-427f-41d4-b7c2-8cde5e501453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.085742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 533/1064] 10.222.0.89 () {56 vars in 1115 bytes} [Tue Aug 30 00:50:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:49.091435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.102040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5e8f902b-427f-41d4-b7c2-8cde5e501453 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:49.103321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5e8f902b-427f-41d4-b7c2-8cde5e501453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:49.176837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 532/1065] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:49.202883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd4a1-8224-48a1-9bbe-de88a35c7fc9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.238525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.239185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.239455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.239718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.251226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:49.252668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:49.267390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:49.268365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:49.269404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:49.269404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:49.269404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:49.269404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 534/1066] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:49.274412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f902b-427f-41d4-b7c2-8cde5e501453 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.375509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f902b-427f-41d4-b7c2-8cde5e501453 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.390526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:49.412444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.413082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.413356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.413618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.414313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:49.414738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:49.416208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:49.427919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 533/1067] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:49.434157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.442139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.476782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:49.549672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b00bce-aa8a-4d07-8fa0-3c9b077bc50d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.552666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08345cb-3d16-428b-b2cc-2ecc40bc5076 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.586714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.587455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.587760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.588196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.591314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.591974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.592249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.592519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.599734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:49.600235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:49.601724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:49.604690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:49.605682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:49.606539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 534/1068] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:49.611878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:49.618257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:49.619311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:49.620247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:49.625023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 535/1069] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:49.626145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.649133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:49.721982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d235-ee77-4757-a1fa-7f35fce8cc03 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.729226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:49.735531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334cf8-0a3e-4569-8d24-ad35a82780ac None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.767740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ddb96-ebe3-4068-b64a-c6a303a29329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.768362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ddb96-ebe3-4068-b64a-c6a303a29329 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.768647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ddb96-ebe3-4068-b64a-c6a303a29329 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.768944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ddb96-ebe3-4068-b64a-c6a303a29329 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.769628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ddb96-ebe3-4068-b64a-c6a303a29329 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:49.769928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ddb96-ebe3-4068-b64a-c6a303a29329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:49.770761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590db3d9-8bd0-42a2-8022-2d2f2767870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.771346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ddb96-ebe3-4068-b64a-c6a303a29329 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:49.771440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590db3d9-8bd0-42a2-8022-2d2f2767870a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.771637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590db3d9-8bd0-42a2-8022-2d2f2767870a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.771899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590db3d9-8bd0-42a2-8022-2d2f2767870a None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.772625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590db3d9-8bd0-42a2-8022-2d2f2767870a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:49.772958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590db3d9-8bd0-42a2-8022-2d2f2767870a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:49.774349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590db3d9-8bd0-42a2-8022-2d2f2767870a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:49.781449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 535/1070] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:49.782657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbdda4-41c7-43c6-9c52-f2dcd13b577b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.782994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbdda4-41c7-43c6-9c52-f2dcd13b577b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.783268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbdda4-41c7-43c6-9c52-f2dcd13b577b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.785169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 536/1071] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:49.787540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbdda4-41c7-43c6-9c52-f2dcd13b577b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.793735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 536/1072] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:49.795299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929790d-c0d6-49b9-b9b1-f219b87fb296 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.795582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929790d-c0d6-49b9-b9b1-f219b87fb296 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.795853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929790d-c0d6-49b9-b9b1-f219b87fb296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.814039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9929790d-c0d6-49b9-b9b1-f219b87fb296 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:49.815264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9929790d-c0d6-49b9-b9b1-f219b87fb296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:49.879993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 537/1073] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:49.880785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929790d-c0d6-49b9-b9b1-f219b87fb296 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.886944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:49.894688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbdda4-41c7-43c6-9c52-f2dcd13b577b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:49.931872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:49.932495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:49.932773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:49.933079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] PATH_INFO: `/v3/users/a68fe5877ff64711a82b983687b3da2e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:49.934217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] RBAC: Authorizing `identity:get_user(user_id=a68fe5877ff64711a82b983687b3da2e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:49.935653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:49.937290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 537/1074] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/users/a68fe5877ff64711a82b983687b3da2e => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:49.943098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:49.973127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:49.991169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929790d-c0d6-49b9-b9b1-f219b87fb296 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.027167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.027814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.028091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.028363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.038638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.040093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.047884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a450d-e192-4083-a9cb-3e055c20f43f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:50.055595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:50.056596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:50.057546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:50.057546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:50.057546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:50.057546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 538/1075] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:50.063279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.088571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.089236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.089506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.089770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.090892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] RBAC: Authorizing `identity:get_project(project_id=f6ea2887d10443bb823686fb7798424c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.092320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.098982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 538/1076] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:50:49 2022] GET /identity/v3/projects/f6ea2887d10443bb823686fb7798424c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:50.100164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.135104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:50.173607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa32353-ec83-4e07-8bab-8e8d50bf8769 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.204652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f74050-14cf-4ab9-bae8-4834966af793 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.208374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.208995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.209387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.209498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.210160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:50.210443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.211872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.215364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:50.225857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 539/1077] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:50.226696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.241531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.242559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.242832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.243099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c/users/a68fe5877ff64711a82b983687b3da2e/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.245687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ea2887d10443bb823686fb7798424c, user_id=a68fe5877ff64711a82b983687b3da2e, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.247134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.263242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 539/1078] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:50:50 2022] PUT /identity/v3/projects/f6ea2887d10443bb823686fb7798424c/users/a68fe5877ff64711a82b983687b3da2e/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:50:50.264060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.351908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777fdbe-6101-47a4-8e76-00ac7526c9a9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.379015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:50.391730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350040e3-64fd-4350-90a6-f5836af63816 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.394745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290849f4-df02-4207-aeec-283d23004554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.395383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290849f4-df02-4207-aeec-283d23004554 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.395663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290849f4-df02-4207-aeec-283d23004554 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.395932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290849f4-df02-4207-aeec-283d23004554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.433514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.434257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.434531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.434902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.442178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.443757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:50.455985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:50.456963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:50.457899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 540/1079] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:50.464751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.468919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:50.477912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290849f4-df02-4207-aeec-283d23004554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.479490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290849f4-df02-4207-aeec-283d23004554 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.582673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a40c-cd97-411b-97d3-9d06d9f5d3ab None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.586210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 540/1080] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:50.592569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290849f4-df02-4207-aeec-283d23004554 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.619481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.619481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.620534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.620891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.621587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:50.621885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.623330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.637017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 541/1081] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:50.643104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.658794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:50.702385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:50.710427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290849f4-df02-4207-aeec-283d23004554 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.754218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.754836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.755115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.755272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827925e-cf4a-4aad-9471-99f68a652067 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.755370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.766800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.768324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:50.784689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:50.785708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:50.786616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:50.786616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:50.786616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:50.791646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 541/1082] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:50.792506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:50.794839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee0f2a-5501-41c7-85db-5deaf51bfc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.795512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0f2a-5501-41c7-85db-5deaf51bfc74 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.795791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0f2a-5501-41c7-85db-5deaf51bfc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.796067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0f2a-5501-41c7-85db-5deaf51bfc74 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/e9a6ec078043424aa591043afcc32c3a/roles/5479b14ccd7d4dfe8e09caa97ffded9e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.798362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee0f2a-5501-41c7-85db-5deaf51bfc74 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=e9a6ec078043424aa591043afcc32c3a, role_id=5479b14ccd7d4dfe8e09caa97ffded9e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.799805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee0f2a-5501-41c7-85db-5deaf51bfc74 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.814753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 542/1083] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:50:50 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/e9a6ec078043424aa591043afcc32c3a/roles/5479b14ccd7d4dfe8e09caa97ffded9e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:50:50.920731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61613b0f-6e2a-4aa8-84da-7e13c461e858 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:50.960291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88038098-ed39-4fc3-9c7f-2a610cd02513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:50.960663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038098-ed39-4fc3-9c7f-2a610cd02513 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:50.960916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038098-ed39-4fc3-9c7f-2a610cd02513 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:50.961180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038098-ed39-4fc3-9c7f-2a610cd02513 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:50.961848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88038098-ed39-4fc3-9c7f-2a610cd02513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:50.962194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88038098-ed39-4fc3-9c7f-2a610cd02513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:50.963930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88038098-ed39-4fc3-9c7f-2a610cd02513 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:50.978023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 542/1084] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:52.204460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01f77-4030-49ba-b5a4-43a9d2b78d64 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:52.205009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01f77-4030-49ba-b5a4-43a9d2b78d64 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:52.205009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01f77-4030-49ba-b5a4-43a9d2b78d64 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:52.206432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 543/1085] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:52.211897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7207f-5a2c-4970-bc8a-6bef6566c1dd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:52.212362 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7207f-5a2c-4970-bc8a-6bef6566c1dd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:52.212460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7207f-5a2c-4970-bc8a-6bef6566c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:52.231820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-66e7207f-5a2c-4970-bc8a-6bef6566c1dd None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:52.233050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-66e7207f-5a2c-4970-bc8a-6bef6566c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:52.235166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:52.304541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 543/1086] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:52.566955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c01f77-4030-49ba-b5a4-43a9d2b78d64 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:52.641546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:52.672765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c01f77-4030-49ba-b5a4-43a9d2b78d64 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:52.708579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef6403-4bde-4423-b55f-d01da577ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:52.709218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef6403-4bde-4423-b55f-d01da577ca8d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:52.709487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef6403-4bde-4423-b55f-d01da577ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:52.709731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef6403-4bde-4423-b55f-d01da577ca8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:52.720022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef6403-4bde-4423-b55f-d01da577ca8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-02ef6403-4bde-4423-b55f-d01da577ca8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:52.724838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:52.725960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:52.726804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 544/1087] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:50:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:52.732247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7207f-5a2c-4970-bc8a-6bef6566c1dd None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:52.733722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbed44-b15d-4a36-ad3a-2c4deac7e396 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:52.734009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbed44-b15d-4a36-ad3a-2c4deac7e396 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:52.734288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbed44-b15d-4a36-ad3a-2c4deac7e396 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:52.736214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 545/1088] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:50:52.740938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073518b-d415-4c4b-921b-ce4bf699f170 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:52.740938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073518b-d415-4c4b-921b-ce4bf699f170 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:52.741174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073518b-d415-4c4b-921b-ce4bf699f170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:52.761584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2073518b-d415-4c4b-921b-ce4bf699f170 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:52.762797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2073518b-d415-4c4b-921b-ce4bf699f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:52.831155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 546/1089] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:50:52.833924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7207f-5a2c-4970-bc8a-6bef6566c1dd None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:52.869339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:52.869940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:52.870210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:52.870470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:52.871128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:52.871422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:52.872777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:52.877722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:52.881504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 544/1090] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:50:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:52.887030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073518b-d415-4c4b-921b-ce4bf699f170 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:52.949691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:52.991329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073518b-d415-4c4b-921b-ce4bf699f170 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.027573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.028190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.028462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.028724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] PATH_INFO: `/v3/users/a68fe5877ff64711a82b983687b3da2e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.029908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] RBAC: Authorizing `identity:get_user(user_id=a68fe5877ff64711a82b983687b3da2e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.031361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.033012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 547/1091] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:50:52 2022] GET /identity/v3/users/a68fe5877ff64711a82b983687b3da2e => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:53.039204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.103593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.140635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4464c1-ebeb-45f0-9900-2788451703fc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.173314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a5031-921b-49b2-b848-425560200341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.173916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5031-921b-49b2-b848-425560200341 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.174192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5031-921b-49b2-b848-425560200341 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.174458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5031-921b-49b2-b848-425560200341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.207874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782079e-f86d-49df-a720-c8a9382a36be None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.239020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:53.240965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:53.243542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a5031-921b-49b2-b848-425560200341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.245251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a5031-921b-49b2-b848-425560200341 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.246225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.246876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.247309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.247590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.257999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:50:53.263083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:53.264049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:53.264920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 548/1092] 10.222.0.89 () {56 vars in 1120 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:53.270294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.352157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 545/1093] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:53.358631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a5031-921b-49b2-b848-425560200341 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.376452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb614263-ad8a-4354-a971-e655ef0d9e77 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.409989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.410601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.410875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.411141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.411814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:53.412120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.413545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.422081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 549/1094] 10.222.0.89 () {56 vars in 1115 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:53.427750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.454343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:53.457449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a5031-921b-49b2-b848-425560200341 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.482891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:53.490701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.491345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.491616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.491880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.493532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] RBAC: Authorizing `identity:get_project(project_id=f6ea2887d10443bb823686fb7798424c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.494966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.496625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 546/1095] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/projects/f6ea2887d10443bb823686fb7798424c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:53.502722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.532917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e66c2-417f-4380-97d6-01e221ef1d33 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.567481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.568114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.568386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.568652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.580508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.581993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:53.596366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:53.597569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:53.598651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:53.598651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:53.598651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:53.598651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 550/1096] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:53.603869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.605057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3ea0f-6431-41c0-b073-e3886c8596d3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.641271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.641901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.642186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.642455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.643201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=f6ea2887d10443bb823686fb7798424c, user.id=a68fe5877ff64711a82b983687b3da2e) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:53.643503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.644959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.651573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 547/1097] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/role_assignments?user.id=a68fe5877ff64711a82b983687b3da2e&scope.project.id=f6ea2887d10443bb823686fb7798424c&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:53.718017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e927f-00c3-4019-b1f7-e6c1f35e79f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.720936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:53.764675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.765350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.765625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.765893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.766575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:53.766903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.768366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.783697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 551/1098] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:50:53.789907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:53.827079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:53.895540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ba07-70e0-44c1-9b76-bd5b532fba40 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:53.931227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:53.931869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:53.932160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:53.932423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:53.940305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:53.941769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:50:53.952834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:53.953784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:50:53.954794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 548/1099] 10.222.0.89 () {56 vars in 1093 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:50:53.959915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:54.068757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d86fd7-c95f-4568-867e-deffd092cf6d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:54.105318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:54.105915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:54.106188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:54.106452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:54.107178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:54.107458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:54.108916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:54.127639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 552/1100] 10.222.0.89 () {56 vars in 1133 bytes} [Tue Aug 30 00:50:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:54.134363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:54.234211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:54.244613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6130fee-925c-4a81-8998-ca9e9ba888e6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:54.279984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:54.280623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:54.280924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:54.281195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:54.352064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:54.354233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:54.447849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:54.457777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 549/1101] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:54.463980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:54.489366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:54.567631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cdf6a-6081-40cf-acf3-0a633bb67466 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:54.603119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:54.603749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:54.604025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:54.604294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:54.614602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:54.616059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:50:54.632600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:54.633639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:50:54.634757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:50:54.634757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:50:54.634757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:54.634757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 553/1102] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:54.640307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:54.752849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdec320-e128-489c-a32d-10686ae38f1a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:54.790535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:54.791149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:54.791424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:54.791690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:54.792333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:54.792633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:54.794036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:54.805708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 550/1103] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:54.811614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:54.888664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:54.914693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227642-3d70-41c3-a179-f2e3d2435de4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:54.949542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:54.950159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:54.950435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:54.950704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:54.958710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:54.960173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:50:54.972720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:50:54.973762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:50:54.974932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 554/1104] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:50:54.979938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:55.036128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:55.084935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38ff6c-1bdb-4900-ad01-88d3c402b569 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:55.120505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e6e39-0b2b-482b-97dd-993923270341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:55.121156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e6e39-0b2b-482b-97dd-993923270341 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:55.121434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e6e39-0b2b-482b-97dd-993923270341 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:55.121698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e6e39-0b2b-482b-97dd-993923270341 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:55.122382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e6e39-0b2b-482b-97dd-993923270341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:55.122684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e6e39-0b2b-482b-97dd-993923270341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:55.124128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e6e39-0b2b-482b-97dd-993923270341 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:55.137310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 551/1105] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:55.143747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:55.247712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f664a5-aa90-4b07-ad1e-32e47691d31f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:55.283465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf424a-9b28-44f7-a23c-0ccd9a79e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:55.284093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf424a-9b28-44f7-a23c-0ccd9a79e64e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:55.284371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf424a-9b28-44f7-a23c-0ccd9a79e64e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:55.284637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf424a-9b28-44f7-a23c-0ccd9a79e64e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:55.285417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf424a-9b28-44f7-a23c-0ccd9a79e64e None admin] RBAC: Adding query filter params (role.id=5479b14ccd7d4dfe8e09caa97ffded9e, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=e9a6ec078043424aa591043afcc32c3a) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:55.285725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf424a-9b28-44f7-a23c-0ccd9a79e64e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:55.287250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf424a-9b28-44f7-a23c-0ccd9a79e64e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:55.289034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:55.294670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 555/1106] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:55 2022] GET /identity/v3/role_assignments?user.id=e9a6ec078043424aa591043afcc32c3a&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=5479b14ccd7d4dfe8e09caa97ffded9e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:55.598870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d8ec-bea4-4e14-8975-d18eaf050d4c None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:55.599399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d8ec-bea4-4e14-8975-d18eaf050d4c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:55.599399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d8ec-bea4-4e14-8975-d18eaf050d4c None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:55.600633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 552/1107] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:55.606300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af77b-21cd-45d7-b225-6bd1dbf123c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:55.606760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af77b-21cd-45d7-b225-6bd1dbf123c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:55.606851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af77b-21cd-45d7-b225-6bd1dbf123c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:55.626753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f81af77b-21cd-45d7-b225-6bd1dbf123c9 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:55.627938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f81af77b-21cd-45d7-b225-6bd1dbf123c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:55.699776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 556/1108] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:55.971510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886d8ec-bea4-4e14-8975-d18eaf050d4c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:56.082625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886d8ec-bea4-4e14-8975-d18eaf050d4c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:56.097466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:56.121193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795ea3-bd4f-48e4-891b-621561071d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:56.121842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795ea3-bd4f-48e4-891b-621561071d35 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:56.122120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795ea3-bd4f-48e4-891b-621561071d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:56.122391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795ea3-bd4f-48e4-891b-621561071d35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:56.123530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64795ea3-bd4f-48e4-891b-621561071d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:56.125010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64795ea3-bd4f-48e4-891b-621561071d35 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:56.126605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 553/1109] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:56.132762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af77b-21cd-45d7-b225-6bd1dbf123c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:56.243611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af77b-21cd-45d7-b225-6bd1dbf123c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:56.271591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:56.282278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138bf52-d762-4c31-a220-f7cebcc43b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:56.282913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138bf52-d762-4c31-a220-f7cebcc43b32 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:56.283187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138bf52-d762-4c31-a220-f7cebcc43b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:56.283453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138bf52-d762-4c31-a220-f7cebcc43b32 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:56.284096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138bf52-d762-4c31-a220-f7cebcc43b32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:56.285564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138bf52-d762-4c31-a220-f7cebcc43b32 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:56.311947 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 557/1110] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:50:56 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:50:58.310011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc9a9-301a-4418-8d1b-0377320c626d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:58.310645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc9a9-301a-4418-8d1b-0377320c626d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:58.310645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc9a9-301a-4418-8d1b-0377320c626d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:58.311912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 554/1111] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:50:58.318396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfe98-4eb8-493d-a3dd-74cf6f7ccc8c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:58.319174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfe98-4eb8-493d-a3dd-74cf6f7ccc8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:58.319336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfe98-4eb8-493d-a3dd-74cf6f7ccc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:58.339858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a4cfe98-4eb8-493d-a3dd-74cf6f7ccc8c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:50:58.341085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a4cfe98-4eb8-493d-a3dd-74cf6f7ccc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:58.414209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 558/1112] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:50:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:50:58.678513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefc9a9-301a-4418-8d1b-0377320c626d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:58.790081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefc9a9-301a-4418-8d1b-0377320c626d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:58.826340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:58.826966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:58.827242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:58.827507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] PATH_INFO: `/v3/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:58.828985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] RBAC: Authorizing `identity:get_role(role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:58.830330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:58.831663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 555/1113] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:50:58 2022] GET /identity/v3/roles/407978df648d44abb9a8aafed3b0793f => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:58.838319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfe98-4eb8-493d-a3dd-74cf6f7ccc8c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:58.945932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfe98-4eb8-493d-a3dd-74cf6f7ccc8c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:58.959958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:58.981307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:58.981919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:58.982188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:58.982452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] PATH_INFO: `/v3/users/722b3b8e456e4aa7a40a21068179744a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:58.996057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] RBAC: Authorizing `identity:get_user(user_id=722b3b8e456e4aa7a40a21068179744a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:58.997523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:58.999123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 559/1114] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:50:58 2022] GET /identity/v3/users/722b3b8e456e4aa7a40a21068179744a => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:59.005562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:59.063797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:59.121860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264b29-00e7-44fa-bff2-87435203bc5b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:59.163450 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:59.164057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:59.164331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:59.164600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:59.236769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:59.238170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:59.286037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:59.337546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 556/1115] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:50:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:50:59.347229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:59.473088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2005a-1b69-4374-a48e-a833940ae9f9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:59.509650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74362120-1263-4515-b765-068bba50f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:59.510283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362120-1263-4515-b765-068bba50f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:59.510558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362120-1263-4515-b765-068bba50f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:59.510819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362120-1263-4515-b765-068bba50f0a5 None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:59.512049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74362120-1263-4515-b765-068bba50f0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=f6ea2887d10443bb823686fb7798424c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:59.513513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74362120-1263-4515-b765-068bba50f0a5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:59.515170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 560/1116] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:50:59 2022] GET /identity/v3/projects/f6ea2887d10443bb823686fb7798424c => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:50:59.522185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:59.632408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e015d-0213-4f80-9697-f8947a07a28a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:59.668239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3848-fdc3-46d6-92d8-b788fb5a2a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:59.668872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3848-fdc3-46d6-92d8-b788fb5a2a2e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:59.669147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3848-fdc3-46d6-92d8-b788fb5a2a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:59.669414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3848-fdc3-46d6-92d8-b788fb5a2a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:59.670139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3848-fdc3-46d6-92d8-b788fb5a2a2e None admin] RBAC: Adding query filter params (role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=f6ea2887d10443bb823686fb7798424c, user.id=722b3b8e456e4aa7a40a21068179744a) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:50:59.670440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3848-fdc3-46d6-92d8-b788fb5a2a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:59.671866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3848-fdc3-46d6-92d8-b788fb5a2a2e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:59.677303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 557/1117] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:50:59 2022] GET /identity/v3/role_assignments?user.id=722b3b8e456e4aa7a40a21068179744a&scope.project.id=f6ea2887d10443bb823686fb7798424c&role.id=407978df648d44abb9a8aafed3b0793f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:01.526574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1adc-b60e-4aab-b8a4-15c2dacff28f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:01.527165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1adc-b60e-4aab-b8a4-15c2dacff28f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:01.527165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1adc-b60e-4aab-b8a4-15c2dacff28f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:01.528420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 561/1118] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:01.534767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a52f-3600-47a5-b76b-29d21e6b23aa None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:01.535559 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a52f-3600-47a5-b76b-29d21e6b23aa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:01.535696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a52f-3600-47a5-b76b-29d21e6b23aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:01.563300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5763a52f-3600-47a5-b76b-29d21e6b23aa None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:01.564473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5763a52f-3600-47a5-b76b-29d21e6b23aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:01.572475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:01.638505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 558/1119] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:01.908899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1adc-b60e-4aab-b8a4-15c2dacff28f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:01.957897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:02.020879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1adc-b60e-4aab-b8a4-15c2dacff28f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:02.060986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:02.061610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:02.061887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:02.062152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] PATH_INFO: `/v3/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:02.063707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] RBAC: Authorizing `identity:get_role(role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:02.065124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:02.066462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 562/1120] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:01 2022] GET /identity/v3/roles/407978df648d44abb9a8aafed3b0793f => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:02.072918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a52f-3600-47a5-b76b-29d21e6b23aa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:02.182259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a52f-3600-47a5-b76b-29d21e6b23aa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:02.216747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:02.217445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:02.217768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:02.218079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] PATH_INFO: `/v3/users/722b3b8e456e4aa7a40a21068179744a` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:02.219321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] RBAC: Authorizing `identity:get_user(user_id=722b3b8e456e4aa7a40a21068179744a)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:02.220789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:02.222409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 559/1121] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:02 2022] GET /identity/v3/users/722b3b8e456e4aa7a40a21068179744a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:02.228599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:02.330975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4043a82-c9fd-44a3-8e9b-d0a55632403b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:02.340253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:02.380311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7d6e6-c2d5-462b-897c-b79571fee490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:02.380952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d6e6-c2d5-462b-897c-b79571fee490 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:02.381225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d6e6-c2d5-462b-897c-b79571fee490 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:02.381492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d6e6-c2d5-462b-897c-b79571fee490 None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:02.382734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7d6e6-c2d5-462b-897c-b79571fee490 None admin] RBAC: Authorizing `identity:get_project(project_id=f6ea2887d10443bb823686fb7798424c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:02.384197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7d6e6-c2d5-462b-897c-b79571fee490 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:02.385815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 563/1122] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:02 2022] GET /identity/v3/projects/f6ea2887d10443bb823686fb7798424c => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:51:02.391996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:02.405989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:02.505870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d90eaa-b715-4e82-9364-4161e6ffb30f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:02.541928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47733cfa-eb44-4dcd-81a4-353406b6a0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:02.542537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733cfa-eb44-4dcd-81a4-353406b6a0bb None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:02.542847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733cfa-eb44-4dcd-81a4-353406b6a0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:02.543114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47733cfa-eb44-4dcd-81a4-353406b6a0bb None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c/users/722b3b8e456e4aa7a40a21068179744a/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:02.545648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47733cfa-eb44-4dcd-81a4-353406b6a0bb None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ea2887d10443bb823686fb7798424c, user_id=722b3b8e456e4aa7a40a21068179744a, role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:02.547078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47733cfa-eb44-4dcd-81a4-353406b6a0bb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:02.564556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 560/1123] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:51:02 2022] PUT /identity/v3/projects/f6ea2887d10443bb823686fb7798424c/users/722b3b8e456e4aa7a40a21068179744a/roles/407978df648d44abb9a8aafed3b0793f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:51:04.428424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f198f-813b-4838-8209-2af749c24fbb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:04.429403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f198f-813b-4838-8209-2af749c24fbb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:04.429403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f198f-813b-4838-8209-2af749c24fbb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:04.431379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 564/1124] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:04.436979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad01b3-9c3e-4138-807b-cd0ce1ec049c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:04.437444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad01b3-9c3e-4138-807b-cd0ce1ec049c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:04.437539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad01b3-9c3e-4138-807b-cd0ce1ec049c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:04.459071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e1ad01b3-9c3e-4138-807b-cd0ce1ec049c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:04.460273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e1ad01b3-9c3e-4138-807b-cd0ce1ec049c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:04.525449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:04.532499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 561/1125] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:04.813265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f198f-813b-4838-8209-2af749c24fbb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:04.930245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f198f-813b-4838-8209-2af749c24fbb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:04.966003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:04.966606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:04.966878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:04.967144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] PATH_INFO: `/v3/roles/407978df648d44abb9a8aafed3b0793f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:04.968575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] RBAC: Authorizing `identity:get_role(role_id=407978df648d44abb9a8aafed3b0793f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:04.969982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:04.971293 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 565/1126] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:04 2022] GET /identity/v3/roles/407978df648d44abb9a8aafed3b0793f => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:04.978131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad01b3-9c3e-4138-807b-cd0ce1ec049c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:05.104880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad01b3-9c3e-4138-807b-cd0ce1ec049c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:05.144488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:05.145183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:05.145464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:05.145730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] PATH_INFO: `/v3/users/722b3b8e456e4aa7a40a21068179744a` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:05.146993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] RBAC: Authorizing `identity:get_user(user_id=722b3b8e456e4aa7a40a21068179744a)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:05.148464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:05.150476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 562/1127] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:04 2022] GET /identity/v3/users/722b3b8e456e4aa7a40a21068179744a => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:05.156692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:05.209768 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:05.271673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c57c4-f6f7-4035-a847-559a4c54692c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:05.310795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:05.311388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:05.311691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:05.311951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:05.388670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:05.390201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:05.436935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:05.504497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 566/1128] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:51:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:51:05.512172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:05.581719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:05.625706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c76bb-7123-4e95-8817-5f1a1f64b2de None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:05.661787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcb05c-00ff-4456-8b10-bbf0c3614238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:05.662338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcb05c-00ff-4456-8b10-bbf0c3614238 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:05.662612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcb05c-00ff-4456-8b10-bbf0c3614238 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:05.662882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcb05c-00ff-4456-8b10-bbf0c3614238 None admin] PATH_INFO: `/v3/projects/f6ea2887d10443bb823686fb7798424c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:05.664036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcb05c-00ff-4456-8b10-bbf0c3614238 None admin] RBAC: Authorizing `identity:get_project(project_id=f6ea2887d10443bb823686fb7798424c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:05.665623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcb05c-00ff-4456-8b10-bbf0c3614238 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:05.667240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 563/1129] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:05 2022] GET /identity/v3/projects/f6ea2887d10443bb823686fb7798424c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:05.674208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:05.801054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e9d0-cab4-4885-b071-7a72d930f7b6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:05.835904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb01a-3f95-4bb5-a1d8-d095ef3712d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:05.836532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb01a-3f95-4bb5-a1d8-d095ef3712d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:05.836838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb01a-3f95-4bb5-a1d8-d095ef3712d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:05.837300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb01a-3f95-4bb5-a1d8-d095ef3712d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:05.838040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157eb01a-3f95-4bb5-a1d8-d095ef3712d7 None admin] RBAC: Adding query filter params (role.id=407978df648d44abb9a8aafed3b0793f, scope.project.id=f6ea2887d10443bb823686fb7798424c, user.id=722b3b8e456e4aa7a40a21068179744a) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:05.838342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157eb01a-3f95-4bb5-a1d8-d095ef3712d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:05.839765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157eb01a-3f95-4bb5-a1d8-d095ef3712d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:05.845737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 567/1130] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:51:05 2022] GET /identity/v3/role_assignments?user.id=722b3b8e456e4aa7a40a21068179744a&scope.project.id=f6ea2887d10443bb823686fb7798424c&role.id=407978df648d44abb9a8aafed3b0793f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:07.726634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347fa08-7694-4a0e-bc25-572a7f577737 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:07.727242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347fa08-7694-4a0e-bc25-572a7f577737 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:07.727372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347fa08-7694-4a0e-bc25-572a7f577737 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:07.728637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 564/1131] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:07.735043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06890f-21c2-43cc-aedd-7181b7b350a7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:07.735772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06890f-21c2-43cc-aedd-7181b7b350a7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:07.735919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06890f-21c2-43cc-aedd-7181b7b350a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:07.758459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2d06890f-21c2-43cc-aedd-7181b7b350a7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:07.759702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d06890f-21c2-43cc-aedd-7181b7b350a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:07.761753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:07.836004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 568/1132] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:51:08.116316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347fa08-7694-4a0e-bc25-572a7f577737 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:08.248783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347fa08-7694-4a0e-bc25-572a7f577737 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:08.283913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315f6d5-ba95-401a-95c5-d4a23052b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:08.284525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f6d5-ba95-401a-95c5-d4a23052b1ab None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:08.284817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f6d5-ba95-401a-95c5-d4a23052b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:08.285096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f6d5-ba95-401a-95c5-d4a23052b1ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:08.286199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315f6d5-ba95-401a-95c5-d4a23052b1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:08.287621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315f6d5-ba95-401a-95c5-d4a23052b1ab None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:08.289221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 565/1133] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:51:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:08.296178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06890f-21c2-43cc-aedd-7181b7b350a7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:08.405918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06890f-21c2-43cc-aedd-7181b7b350a7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:08.440795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549521af-b18a-4166-b879-9278f646fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:08.441428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549521af-b18a-4166-b879-9278f646fbc3 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:08.441701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549521af-b18a-4166-b879-9278f646fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:08.441966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549521af-b18a-4166-b879-9278f646fbc3 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:08.442611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549521af-b18a-4166-b879-9278f646fbc3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:08.444037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549521af-b18a-4166-b879-9278f646fbc3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:08.453798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:08.475230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 569/1134] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:51:08 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:51:10.387346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb810-44cd-4178-9f25-8ccd2542092e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:10.387945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb810-44cd-4178-9f25-8ccd2542092e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:10.387945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdb810-44cd-4178-9f25-8ccd2542092e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:10.389247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 566/1135] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:10.395709 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f75ff-dbba-42db-b47e-249d1af0d518 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:10.396487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f75ff-dbba-42db-b47e-249d1af0d518 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:10.396633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f75ff-dbba-42db-b47e-249d1af0d518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:10.418600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c22f75ff-dbba-42db-b47e-249d1af0d518 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:10.419801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c22f75ff-dbba-42db-b47e-249d1af0d518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:10.493864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 570/1136] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:10.763662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb810-44cd-4178-9f25-8ccd2542092e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:10.767891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:10.871142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdb810-44cd-4178-9f25-8ccd2542092e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:10.906188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b137a7-a17a-434a-a20d-29945c3f621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:10.906798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b137a7-a17a-434a-a20d-29945c3f621b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:10.907069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b137a7-a17a-434a-a20d-29945c3f621b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:10.907334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b137a7-a17a-434a-a20d-29945c3f621b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:10.908546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b137a7-a17a-434a-a20d-29945c3f621b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:10.909968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b137a7-a17a-434a-a20d-29945c3f621b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:10.911503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 567/1137] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:51:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:10.917837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f75ff-dbba-42db-b47e-249d1af0d518 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:11.029148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f75ff-dbba-42db-b47e-249d1af0d518 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:11.050103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:11.067407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b015e8-ebe0-42a7-82be-cbd07d4e757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:11.068009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b015e8-ebe0-42a7-82be-cbd07d4e757d None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:11.068281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b015e8-ebe0-42a7-82be-cbd07d4e757d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:11.068546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b015e8-ebe0-42a7-82be-cbd07d4e757d None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:11.069219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b015e8-ebe0-42a7-82be-cbd07d4e757d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:11.070744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b015e8-ebe0-42a7-82be-cbd07d4e757d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:11.093883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 571/1138] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:51:10 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:51:13.017659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b734f6-5142-46f5-b66f-40a1192d7e9e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:13.018187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b734f6-5142-46f5-b66f-40a1192d7e9e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:13.018187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b734f6-5142-46f5-b66f-40a1192d7e9e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:13.019458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 568/1139] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:13.025892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e407f6-18b5-416f-9d61-154832555104 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:13.026640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e407f6-18b5-416f-9d61-154832555104 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:13.026969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e407f6-18b5-416f-9d61-154832555104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:13.059229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-98e407f6-18b5-416f-9d61-154832555104 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:13.061067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98e407f6-18b5-416f-9d61-154832555104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:13.136183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 572/1140] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:13.419067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b734f6-5142-46f5-b66f-40a1192d7e9e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:13.509797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:13.545495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b734f6-5142-46f5-b66f-40a1192d7e9e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:13.591901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:13.592528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:13.592836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:13.593101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:13.603806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:51:13.608577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:51:13.609631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:51:13.610749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 569/1141] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:51:13.616221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e407f6-18b5-416f-9d61-154832555104 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:13.725470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e407f6-18b5-416f-9d61-154832555104 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:13.734090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:13.768924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:13.769540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:13.769815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:13.770083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:13.770754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:13.771052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:13.772438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:13.780472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 573/1142] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:13.786389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:13.893448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092c7c0-8a70-4d66-b1e4-1e7022a91dca None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:13.923528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:13.929473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:13.930202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:13.930476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:13.930741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] PATH_INFO: `/v3/users/127593e9a3f546f0a7e612900d4df00c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:13.944359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] RBAC: Authorizing `identity:get_user(user_id=127593e9a3f546f0a7e612900d4df00c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:13.945831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:13.947429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 570/1143] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:13 2022] GET /identity/v3/users/127593e9a3f546f0a7e612900d4df00c => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:13.953837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:14.061379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b070-9627-4289-9aa0-d70ca83def06 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:14.103599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:14.104205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:14.104478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:14.104739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:14.142560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:14.181163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:14.182607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:14.301155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 574/1144] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:51:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:51:14.309130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:14.416683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67decccb-7e26-4b46-a748-1f484d75c439 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:14.453657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ae89f-0d4c-44c2-8266-7cf5b49e5f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:14.454288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae89f-0d4c-44c2-8266-7cf5b49e5f9e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:14.454559 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae89f-0d4c-44c2-8266-7cf5b49e5f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:14.454827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae89f-0d4c-44c2-8266-7cf5b49e5f9e None admin] PATH_INFO: `/v3/projects/54e749d647314db4b4a84e0b09d399ba` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:14.456065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ae89f-0d4c-44c2-8266-7cf5b49e5f9e None admin] RBAC: Authorizing `identity:get_project(project_id=54e749d647314db4b4a84e0b09d399ba)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:14.457519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ae89f-0d4c-44c2-8266-7cf5b49e5f9e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:14.459178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 571/1145] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:14 2022] GET /identity/v3/projects/54e749d647314db4b4a84e0b09d399ba => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:14.465926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:14.531677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:14.572638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4e5e9-dc24-476b-a62d-b6952e3124ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:14.608837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd619d2-3073-4d4a-8d2a-b6a5ae0eea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:14.609463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd619d2-3073-4d4a-8d2a-b6a5ae0eea40 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:14.609736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd619d2-3073-4d4a-8d2a-b6a5ae0eea40 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:14.610002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd619d2-3073-4d4a-8d2a-b6a5ae0eea40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:14.610721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd619d2-3073-4d4a-8d2a-b6a5ae0eea40 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=54e749d647314db4b4a84e0b09d399ba, user.id=127593e9a3f546f0a7e612900d4df00c) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:14.611024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd619d2-3073-4d4a-8d2a-b6a5ae0eea40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:14.612462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd619d2-3073-4d4a-8d2a-b6a5ae0eea40 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:14.618697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 575/1146] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:51:14 2022] GET /identity/v3/role_assignments?user.id=127593e9a3f546f0a7e612900d4df00c&scope.project.id=54e749d647314db4b4a84e0b09d399ba&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:16.443495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ebfe-6459-417c-94aa-e3c77acfec3c None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:16.444107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ebfe-6459-417c-94aa-e3c77acfec3c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:16.444107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ebfe-6459-417c-94aa-e3c77acfec3c None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:16.445446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 572/1147] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:16.451754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290015-550d-4c4d-969b-49cc34801824 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:16.452511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290015-550d-4c4d-969b-49cc34801824 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:16.452655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41290015-550d-4c4d-969b-49cc34801824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:16.476507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-41290015-550d-4c4d-969b-49cc34801824 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:16.477720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41290015-550d-4c4d-969b-49cc34801824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:16.566839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 576/1148] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:16.839680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ebfe-6459-417c-94aa-e3c77acfec3c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:16.905606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:16.951713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ebfe-6459-417c-94aa-e3c77acfec3c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:16.986930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:16.987539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:16.987813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:16.988080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:16.999351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:51:17.003915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:51:17.005109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:51:17.006076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 573/1149] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:51:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:51:17.012010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290015-550d-4c4d-969b-49cc34801824 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:17.084585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:17.125929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41290015-550d-4c4d-969b-49cc34801824 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:17.160925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:17.161517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:17.161790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:17.162038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:17.162693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:17.162991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:17.164556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:17.172536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 577/1150] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:51:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:17.181453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:17.295083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746eee4-85c5-4fa7-96b8-de51060166f0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:17.314806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:17.342240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:17.342874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:17.343148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:17.343414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] PATH_INFO: `/v3/users/127593e9a3f546f0a7e612900d4df00c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:17.344670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] RBAC: Authorizing `identity:get_user(user_id=127593e9a3f546f0a7e612900d4df00c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:17.346167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:17.347716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 574/1151] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:17 2022] GET /identity/v3/users/127593e9a3f546f0a7e612900d4df00c => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:17.357076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:17.461110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3416e-ea64-423c-953b-1a2f8fb96099 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:17.484482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:17.498310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac47a72-b95e-4f3a-9818-6bb0a1498702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:17.498929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac47a72-b95e-4f3a-9818-6bb0a1498702 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:17.499204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac47a72-b95e-4f3a-9818-6bb0a1498702 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:17.499472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac47a72-b95e-4f3a-9818-6bb0a1498702 None admin] PATH_INFO: `/v3/projects/54e749d647314db4b4a84e0b09d399ba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:17.500831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac47a72-b95e-4f3a-9818-6bb0a1498702 None admin] RBAC: Authorizing `identity:get_project(project_id=54e749d647314db4b4a84e0b09d399ba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:17.502372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac47a72-b95e-4f3a-9818-6bb0a1498702 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:17.503982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 578/1152] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:17 2022] GET /identity/v3/projects/54e749d647314db4b4a84e0b09d399ba => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:17.511711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:17.615253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a95c70-7a96-4f78-923f-95b9c5302dbb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:17.659031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f79a53-379a-438f-8359-ed6aee83aa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:17.659687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79a53-379a-438f-8359-ed6aee83aa36 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:17.659990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79a53-379a-438f-8359-ed6aee83aa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:17.660258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f79a53-379a-438f-8359-ed6aee83aa36 None admin] PATH_INFO: `/v3/projects/54e749d647314db4b4a84e0b09d399ba/users/127593e9a3f546f0a7e612900d4df00c/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:17.662421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f79a53-379a-438f-8359-ed6aee83aa36 None admin] RBAC: Authorizing `identity:create_grant(project_id=54e749d647314db4b4a84e0b09d399ba, user_id=127593e9a3f546f0a7e612900d4df00c, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:17.664144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f79a53-379a-438f-8359-ed6aee83aa36 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:17.680096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 575/1153] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:51:17 2022] PUT /identity/v3/projects/54e749d647314db4b4a84e0b09d399ba/users/127593e9a3f546f0a7e612900d4df00c/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:51:19.525239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbfcd-f1a5-48d2-98e9-586112272137 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:19.526200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbfcd-f1a5-48d2-98e9-586112272137 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:19.526200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbfcd-f1a5-48d2-98e9-586112272137 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:19.528275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 579/1154] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:19.533918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0af95-523e-43d7-bb17-80fc99adc4c3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:19.534365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0af95-523e-43d7-bb17-80fc99adc4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:19.534480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0af95-523e-43d7-bb17-80fc99adc4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:19.555480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b1e0af95-523e-43d7-bb17-80fc99adc4c3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:19.556668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b1e0af95-523e-43d7-bb17-80fc99adc4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:19.602992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:19.630003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 576/1155] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:19.897512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbfcd-f1a5-48d2-98e9-586112272137 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:20.008554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbfcd-f1a5-48d2-98e9-586112272137 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:20.043335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:20.043945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:20.044218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:20.044477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:20.055639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:51:20.060414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:51:20.061534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:20.062495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:51:20.064976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 580/1156] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:51:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:51:20.067632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0af95-523e-43d7-bb17-80fc99adc4c3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:20.169782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0af95-523e-43d7-bb17-80fc99adc4c3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:20.207795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:20.208399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:20.208669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:20.208967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:20.209613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:20.209907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:20.211298 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:20.219993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 577/1157] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:20.226048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:20.287411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:20.340672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e8a7-7e81-4c90-bf55-b5ecdf5fbe35 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:20.378465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:20.379424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:20.379857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:20.380272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] PATH_INFO: `/v3/users/127593e9a3f546f0a7e612900d4df00c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:20.382366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] RBAC: Authorizing `identity:get_user(user_id=127593e9a3f546f0a7e612900d4df00c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:20.384686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:20.387311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 581/1158] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:20 2022] GET /identity/v3/users/127593e9a3f546f0a7e612900d4df00c => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:20.396612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:20.439649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:20.506142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d50ca-849b-429b-a33b-a020119b8cd2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:20.542902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31580245-13d3-4152-8be7-711313583483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:20.543509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580245-13d3-4152-8be7-711313583483 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:20.543759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580245-13d3-4152-8be7-711313583483 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:20.544036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31580245-13d3-4152-8be7-711313583483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:20.612993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31580245-13d3-4152-8be7-711313583483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:20.614437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31580245-13d3-4152-8be7-711313583483 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:20.653429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:20.716204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 578/1159] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:51:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:51:20.726002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:20.849037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7602a-edc2-4258-86de-55dcf1a609c8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:20.871390 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:20.888050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9a0f-54f8-4460-a476-9e84ba895a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:20.888686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9a0f-54f8-4460-a476-9e84ba895a4d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:20.888985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9a0f-54f8-4460-a476-9e84ba895a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:20.889281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9a0f-54f8-4460-a476-9e84ba895a4d None admin] PATH_INFO: `/v3/projects/54e749d647314db4b4a84e0b09d399ba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:20.890509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9a0f-54f8-4460-a476-9e84ba895a4d None admin] RBAC: Authorizing `identity:get_project(project_id=54e749d647314db4b4a84e0b09d399ba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:20.891956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9a0f-54f8-4460-a476-9e84ba895a4d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:20.893643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 582/1160] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:20 2022] GET /identity/v3/projects/54e749d647314db4b4a84e0b09d399ba => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:20.900407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31580245-13d3-4152-8be7-711313583483 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:21.004021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31580245-13d3-4152-8be7-711313583483 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:21.040846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57465bc1-68e6-4ed1-9f63-5eb3815316ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:21.041465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57465bc1-68e6-4ed1-9f63-5eb3815316ab None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:21.041740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57465bc1-68e6-4ed1-9f63-5eb3815316ab None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:21.042007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57465bc1-68e6-4ed1-9f63-5eb3815316ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:21.042731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57465bc1-68e6-4ed1-9f63-5eb3815316ab None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=54e749d647314db4b4a84e0b09d399ba, user.id=127593e9a3f546f0a7e612900d4df00c) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:21.043037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57465bc1-68e6-4ed1-9f63-5eb3815316ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:21.044465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57465bc1-68e6-4ed1-9f63-5eb3815316ab None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:21.050620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 579/1161] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:51:20 2022] GET /identity/v3/role_assignments?user.id=127593e9a3f546f0a7e612900d4df00c&scope.project.id=54e749d647314db4b4a84e0b09d399ba&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:22.953547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c8e5-abb7-4490-8263-9f01543c7911 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:22.954129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c8e5-abb7-4490-8263-9f01543c7911 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:22.954129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c8e5-abb7-4490-8263-9f01543c7911 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:22.955414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 583/1162] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:22.960849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf35c0-f2f8-43db-94bc-8cea55cfa310 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:22.961275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf35c0-f2f8-43db-94bc-8cea55cfa310 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:22.961372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf35c0-f2f8-43db-94bc-8cea55cfa310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:22.968421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:22.984208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-93cf35c0-f2f8-43db-94bc-8cea55cfa310 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:22.985436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-93cf35c0-f2f8-43db-94bc-8cea55cfa310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:23.072063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 580/1163] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:23.352344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209c8e5-abb7-4490-8263-9f01543c7911 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:23.463712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209c8e5-abb7-4490-8263-9f01543c7911 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:23.501733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:23.502345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:23.502617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:23.502884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:23.564085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:23.580113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:23.581618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:23.692871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 584/1164] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:51:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:51:23.699154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf35c0-f2f8-43db-94bc-8cea55cfa310 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:23.804343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf35c0-f2f8-43db-94bc-8cea55cfa310 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:23.834870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:23.841554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c18e1-212f-4f0d-9aeb-adc2bf129e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:23.842190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c18e1-212f-4f0d-9aeb-adc2bf129e95 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:23.842466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c18e1-212f-4f0d-9aeb-adc2bf129e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:23.842733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c18e1-212f-4f0d-9aeb-adc2bf129e95 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:23.850374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c18e1-212f-4f0d-9aeb-adc2bf129e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:23.851862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c18e1-212f-4f0d-9aeb-adc2bf129e95 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-180c18e1-212f-4f0d-9aeb-adc2bf129e95 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:51:23.863669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:51:23.864843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:51:23.866895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 581/1165] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:51:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:51:23.871676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:23.972589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:23.986301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5424d0-c421-45ee-abdd-39e5ba759c39 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:24.021150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c2c0c-821b-4aeb-be2a-a48e8dc5e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:24.021746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2c0c-821b-4aeb-be2a-a48e8dc5e2df None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:24.022024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2c0c-821b-4aeb-be2a-a48e8dc5e2df None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:24.022299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c2c0c-821b-4aeb-be2a-a48e8dc5e2df None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:24.023068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c2c0c-821b-4aeb-be2a-a48e8dc5e2df None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:24.023461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c2c0c-821b-4aeb-be2a-a48e8dc5e2df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:24.024864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c2c0c-821b-4aeb-be2a-a48e8dc5e2df None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:24.032107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 585/1166] 10.222.0.89 () {56 vars in 1115 bytes} [Tue Aug 30 00:51:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:25.934623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390350b-b0a8-4902-bab0-9e7aec954e19 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:25.935508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390350b-b0a8-4902-bab0-9e7aec954e19 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:25.935508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390350b-b0a8-4902-bab0-9e7aec954e19 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:25.937696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 582/1167] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:25.943842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2c36-5d46-45a9-a7ba-8d4e4520ed29 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:25.944578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2c36-5d46-45a9-a7ba-8d4e4520ed29 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:25.944744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2c36-5d46-45a9-a7ba-8d4e4520ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:25.964400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-366a2c36-5d46-45a9-a7ba-8d4e4520ed29 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:25.965639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-366a2c36-5d46-45a9-a7ba-8d4e4520ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:26.041180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 586/1168] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:26.304118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390350b-b0a8-4902-bab0-9e7aec954e19 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:26.423957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390350b-b0a8-4902-bab0-9e7aec954e19 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:26.459129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e6dbf-4b86-43c5-a21e-1acc73fcaeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:26.459785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e6dbf-4b86-43c5-a21e-1acc73fcaeb6 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:26.460064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e6dbf-4b86-43c5-a21e-1acc73fcaeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:26.460541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e6dbf-4b86-43c5-a21e-1acc73fcaeb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:26.461375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e6dbf-4b86-43c5-a21e-1acc73fcaeb6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:26.462747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e6dbf-4b86-43c5-a21e-1acc73fcaeb6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:26.481321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 583/1169] 10.222.0.89 () {60 vars in 1138 bytes} [Tue Aug 30 00:51:26 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:51:28.383470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75215cbf-b317-45d6-bb6a-862cbcb322f0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:28.384086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75215cbf-b317-45d6-bb6a-862cbcb322f0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:28.384086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75215cbf-b317-45d6-bb6a-862cbcb322f0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:28.385455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 587/1170] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:28.391810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c72d-0152-4a8a-bb8b-93ad8c9954ab None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:28.392610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c72d-0152-4a8a-bb8b-93ad8c9954ab None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:28.392760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c72d-0152-4a8a-bb8b-93ad8c9954ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:28.415173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6476c72d-0152-4a8a-bb8b-93ad8c9954ab None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:28.416355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6476c72d-0152-4a8a-bb8b-93ad8c9954ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:28.466851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:28.488361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 584/1171] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:28.754816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75215cbf-b317-45d6-bb6a-862cbcb322f0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:28.851101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:28.874098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75215cbf-b317-45d6-bb6a-862cbcb322f0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:28.912261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d62e8-808d-4d16-8aad-de68e2a3b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:28.912911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d62e8-808d-4d16-8aad-de68e2a3b8ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:28.913171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d62e8-808d-4d16-8aad-de68e2a3b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:28.913500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d62e8-808d-4d16-8aad-de68e2a3b8ff None admin] PATH_INFO: `/v3/domains/f5912232e5f04822be09c683902391db` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:28.924217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d62e8-808d-4d16-8aad-de68e2a3b8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=f5912232e5f04822be09c683902391db)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:28.925708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d62e8-808d-4d16-8aad-de68e2a3b8ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:28.927299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 588/1172] 10.222.0.89 () {56 vars in 1183 bytes} [Tue Aug 30 00:51:28 2022] GET /identity/v3/domains/f5912232e5f04822be09c683902391db => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:28.936085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476c72d-0152-4a8a-bb8b-93ad8c9954ab None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:29.059544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476c72d-0152-4a8a-bb8b-93ad8c9954ab None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:29.096425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b079-eb02-47f6-b496-d3ba3a6acb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:29.097057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b079-eb02-47f6-b496-d3ba3a6acb49 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:29.097330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b079-eb02-47f6-b496-d3ba3a6acb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:29.097600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b079-eb02-47f6-b496-d3ba3a6acb49 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:29.098246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0b079-eb02-47f6-b496-d3ba3a6acb49 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:29.099648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0b079-eb02-47f6-b496-d3ba3a6acb49 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:29.137303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 585/1173] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:51:28 2022] POST /identity/v3/projects => generated 361 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:51:31.176534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66cc26-7668-423f-8e26-7e804db536af None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:31.177534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66cc26-7668-423f-8e26-7e804db536af None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:31.177534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66cc26-7668-423f-8e26-7e804db536af None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:31.179776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 589/1174] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:31.185263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daeb07-afde-4b9e-8f9f-2e423fcf10bb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:31.185678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daeb07-afde-4b9e-8f9f-2e423fcf10bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:31.185792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daeb07-afde-4b9e-8f9f-2e423fcf10bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:31.205506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-78daeb07-afde-4b9e-8f9f-2e423fcf10bb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:31.206709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-78daeb07-afde-4b9e-8f9f-2e423fcf10bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:31.234211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:31.278283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 586/1175] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:31.543513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66cc26-7668-423f-8e26-7e804db536af None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:31.663166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66cc26-7668-423f-8e26-7e804db536af None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:31.699150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784bcdd-5c7b-4aa5-93ff-6bb1a9176c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:31.699762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bcdd-5c7b-4aa5-93ff-6bb1a9176c47 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:31.700041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bcdd-5c7b-4aa5-93ff-6bb1a9176c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:31.700310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bcdd-5c7b-4aa5-93ff-6bb1a9176c47 None admin] PATH_INFO: `/v3/domains/f5912232e5f04822be09c683902391db` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:31.701579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bcdd-5c7b-4aa5-93ff-6bb1a9176c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f5912232e5f04822be09c683902391db)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:31.703006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bcdd-5c7b-4aa5-93ff-6bb1a9176c47 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:31.704561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 590/1176] 10.222.0.89 () {56 vars in 1183 bytes} [Tue Aug 30 00:51:31 2022] GET /identity/v3/domains/f5912232e5f04822be09c683902391db => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:31.711176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daeb07-afde-4b9e-8f9f-2e423fcf10bb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:31.821225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daeb07-afde-4b9e-8f9f-2e423fcf10bb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:31.856576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da6fe4-e0bf-403b-88c9-9053840125b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:31.857209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6fe4-e0bf-403b-88c9-9053840125b2 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:31.857482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6fe4-e0bf-403b-88c9-9053840125b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:31.857752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6fe4-e0bf-403b-88c9-9053840125b2 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:31.858392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da6fe4-e0bf-403b-88c9-9053840125b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:31.859814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da6fe4-e0bf-403b-88c9-9053840125b2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:31.888639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 587/1177] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:51:31 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:51:33.843139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6822-13d0-4f54-9ea4-7932f7b819fd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:33.843997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6822-13d0-4f54-9ea4-7932f7b819fd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:33.843997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6822-13d0-4f54-9ea4-7932f7b819fd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:33.846225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 591/1178] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:33.853973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd00a-ce6a-43aa-a9fc-50cd9c38411a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:33.854449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd00a-ce6a-43aa-a9fc-50cd9c38411a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:33.854549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dd00a-ce6a-43aa-a9fc-50cd9c38411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:33.875666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2a7dd00a-ce6a-43aa-a9fc-50cd9c38411a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:33.876913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2a7dd00a-ce6a-43aa-a9fc-50cd9c38411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:33.893302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:33.963740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 588/1179] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:51:34.229910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed6822-13d0-4f54-9ea4-7932f7b819fd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:34.244078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:34.339134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed6822-13d0-4f54-9ea4-7932f7b819fd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:34.375960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:34.376903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:34.377384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:34.377799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:34.391370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:51:34.396193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:51:34.397367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:51:34.399385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 592/1180] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:51:34.403987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dd00a-ce6a-43aa-a9fc-50cd9c38411a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:34.509532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dd00a-ce6a-43aa-a9fc-50cd9c38411a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:34.546842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:34.547432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:34.547710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:34.547965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:34.548618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:34.548942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:34.550286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:34.558417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 589/1181] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:51:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:34.564968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:34.643682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:34.677413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bdc11-82b9-4a0e-8034-62c0e90faae0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:34.712569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:34.713267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:34.713553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:34.713824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] PATH_INFO: `/v3/users/4f9ed226c7874ea981faa25ca78432c0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:34.728275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] RBAC: Authorizing `identity:get_user(user_id=4f9ed226c7874ea981faa25ca78432c0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:34.729761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:34.731352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 593/1182] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:34 2022] GET /identity/v3/users/4f9ed226c7874ea981faa25ca78432c0 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:34.741790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:34.758602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:34.845962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff51ea-fcc3-405a-828d-d58c379cf463 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:34.884319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:34.885046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:34.885280 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:34.885552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:34.959528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:34.961165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:34.974674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:35.066972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 590/1183] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:51:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:51:35.077252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:35.191113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718be1-a34c-4c3a-a8c8-fa9046d9609a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:35.233671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:35.245219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ec37-61a4-430b-ae79-1fdaf2581e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:35.245823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ec37-61a4-430b-ae79-1fdaf2581e2f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:35.246120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ec37-61a4-430b-ae79-1fdaf2581e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:35.246392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ec37-61a4-430b-ae79-1fdaf2581e2f None admin] PATH_INFO: `/v3/projects/bb3aa254f6914fffa3b922f658f18360` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:35.247566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99ec37-61a4-430b-ae79-1fdaf2581e2f None admin] RBAC: Authorizing `identity:get_project(project_id=bb3aa254f6914fffa3b922f658f18360)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:35.249053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99ec37-61a4-430b-ae79-1fdaf2581e2f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:35.250681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 594/1184] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:35 2022] GET /identity/v3/projects/bb3aa254f6914fffa3b922f658f18360 => generated 361 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:35.257309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:35.363405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2f3d-5ca4-4baf-b1f3-b4c1dce1ae5d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:35.378458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:35.402531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb03d4-1772-4c45-bce8-69c3e6964151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:35.403154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb03d4-1772-4c45-bce8-69c3e6964151 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:35.403428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb03d4-1772-4c45-bce8-69c3e6964151 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:35.403689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb03d4-1772-4c45-bce8-69c3e6964151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:35.404415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb03d4-1772-4c45-bce8-69c3e6964151 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=bb3aa254f6914fffa3b922f658f18360, user.id=4f9ed226c7874ea981faa25ca78432c0) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:35.404713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb03d4-1772-4c45-bce8-69c3e6964151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:35.406149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb03d4-1772-4c45-bce8-69c3e6964151 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:35.411743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 591/1185] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:51:35 2022] GET /identity/v3/role_assignments?user.id=4f9ed226c7874ea981faa25ca78432c0&scope.project.id=bb3aa254f6914fffa3b922f658f18360&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:37.288175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2eb1-cd94-4ee8-ae6b-3dc56fbfbde4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:37.289071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2eb1-cd94-4ee8-ae6b-3dc56fbfbde4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:37.289165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2eb1-cd94-4ee8-ae6b-3dc56fbfbde4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:37.291943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 595/1186] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:37.298234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317a66-0f99-4bf5-822c-55e9ebcdc0fa None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:37.298974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317a66-0f99-4bf5-822c-55e9ebcdc0fa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:37.299123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317a66-0f99-4bf5-822c-55e9ebcdc0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:37.320004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3a317a66-0f99-4bf5-822c-55e9ebcdc0fa None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:37.321210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3a317a66-0f99-4bf5-822c-55e9ebcdc0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:37.391525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 592/1187] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:37.653220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2eb1-cd94-4ee8-ae6b-3dc56fbfbde4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:37.766346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2eb1-cd94-4ee8-ae6b-3dc56fbfbde4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:37.802934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:37.803636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:37.804078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:37.804391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:37.815265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:51:37.820207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:51:37.821341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:51:37.825820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 596/1188] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:51:37.828137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317a66-0f99-4bf5-822c-55e9ebcdc0fa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:37.932651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317a66-0f99-4bf5-822c-55e9ebcdc0fa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:37.939778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:37.967447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:37.968048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:37.968307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:37.968600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:37.969287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:37.969547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:37.970919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:37.979494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 593/1189] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:37.986342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:38.053023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:38.107373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdf620-1474-4160-b1e0-0158f9af3769 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:38.143100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:38.143702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:38.143973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:38.144237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] PATH_INFO: `/v3/users/4f9ed226c7874ea981faa25ca78432c0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:38.145421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] RBAC: Authorizing `identity:get_user(user_id=4f9ed226c7874ea981faa25ca78432c0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:38.146854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:38.148420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 597/1190] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:37 2022] GET /identity/v3/users/4f9ed226c7874ea981faa25ca78432c0 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:38.154490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:38.271541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c20a38-bbbe-4551-82e5-6f40760e555d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:38.311220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8d2f6-9804-4183-b3c3-b78b7ff3f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:38.311880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d2f6-9804-4183-b3c3-b78b7ff3f0fa None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:38.312187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d2f6-9804-4183-b3c3-b78b7ff3f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:38.312412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d2f6-9804-4183-b3c3-b78b7ff3f0fa None admin] PATH_INFO: `/v3/projects/bb3aa254f6914fffa3b922f658f18360` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:38.313625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8d2f6-9804-4183-b3c3-b78b7ff3f0fa None admin] RBAC: Authorizing `identity:get_project(project_id=bb3aa254f6914fffa3b922f658f18360)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:38.315121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8d2f6-9804-4183-b3c3-b78b7ff3f0fa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:38.316825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 594/1191] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:38 2022] GET /identity/v3/projects/bb3aa254f6914fffa3b922f658f18360 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:38.323399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:38.445187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9136af-32e2-4f59-bbc2-d8069ccaf35e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:38.469163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:38.482950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b376d1-60f7-4255-9ea8-6fc8bb883fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:38.483686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b376d1-60f7-4255-9ea8-6fc8bb883fc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:38.484410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b376d1-60f7-4255-9ea8-6fc8bb883fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:38.485008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b376d1-60f7-4255-9ea8-6fc8bb883fc0 None admin] PATH_INFO: `/v3/projects/bb3aa254f6914fffa3b922f658f18360/users/4f9ed226c7874ea981faa25ca78432c0/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:38.488742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b376d1-60f7-4255-9ea8-6fc8bb883fc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb3aa254f6914fffa3b922f658f18360, user_id=4f9ed226c7874ea981faa25ca78432c0, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:38.491480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b376d1-60f7-4255-9ea8-6fc8bb883fc0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:38.512988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 598/1192] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:51:38 2022] PUT /identity/v3/projects/bb3aa254f6914fffa3b922f658f18360/users/4f9ed226c7874ea981faa25ca78432c0/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:51:40.374202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774389e-c471-42c7-9983-c6eb540ea3da None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:40.375163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774389e-c471-42c7-9983-c6eb540ea3da None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:40.375163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774389e-c471-42c7-9983-c6eb540ea3da None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:40.377441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 595/1193] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:51:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:51:40.384862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992f9cd-88ee-4fa5-a45e-9f57fdac8335 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:40.385282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992f9cd-88ee-4fa5-a45e-9f57fdac8335 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:40.385411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992f9cd-88ee-4fa5-a45e-9f57fdac8335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:40.404724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7992f9cd-88ee-4fa5-a45e-9f57fdac8335 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:51:40.405943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7992f9cd-88ee-4fa5-a45e-9f57fdac8335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:51:40.481692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 599/1194] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:51:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:51:40.753780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774389e-c471-42c7-9983-c6eb540ea3da None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:40.800381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:40.875814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774389e-c471-42c7-9983-c6eb540ea3da None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:40.915895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:40.916524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:40.916827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:40.917090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:40.929104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:51:40.933783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:51:40.934817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:51:40.937877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 596/1195] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:51:40.941160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992f9cd-88ee-4fa5-a45e-9f57fdac8335 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:41.056024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992f9cd-88ee-4fa5-a45e-9f57fdac8335 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:41.070538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:41.092220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:41.092836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:41.093291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:41.093556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:41.094217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:41.094517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:41.095890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:41.104321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 600/1196] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:41.111064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:41.212346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:41.219669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd9b71-0bbe-4a3d-b8bb-d9e8d64d3b8b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:41.258798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:41.259423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:41.259663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:41.259962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] PATH_INFO: `/v3/users/4f9ed226c7874ea981faa25ca78432c0` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:41.261216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] RBAC: Authorizing `identity:get_user(user_id=4f9ed226c7874ea981faa25ca78432c0)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:41.262649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:41.264214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 597/1197] 10.222.0.89 () {56 vars in 1177 bytes} [Tue Aug 30 00:51:41 2022] GET /identity/v3/users/4f9ed226c7874ea981faa25ca78432c0 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:41.273053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:41.381207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ae26e-dce6-4d6b-8b0d-576211f31999 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:41.416164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:41.416765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:41.417039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:41.417303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:41.463014 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:41.486463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:41.487922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:41.603454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 601/1198] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:51:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:51:41.612795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:41.727111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d0a8d-f9aa-4aa5-839b-892bb540f181 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:41.763875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200301-694f-44be-a5c0-9c5ab48b9ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:41.764500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200301-694f-44be-a5c0-9c5ab48b9ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:41.764773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200301-694f-44be-a5c0-9c5ab48b9ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:41.765066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200301-694f-44be-a5c0-9c5ab48b9ea7 None admin] PATH_INFO: `/v3/projects/bb3aa254f6914fffa3b922f658f18360` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:41.766241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200301-694f-44be-a5c0-9c5ab48b9ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=bb3aa254f6914fffa3b922f658f18360)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:41.767698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200301-694f-44be-a5c0-9c5ab48b9ea7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:41.769357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 598/1199] 10.222.0.89 () {56 vars in 1186 bytes} [Tue Aug 30 00:51:41 2022] GET /identity/v3/projects/bb3aa254f6914fffa3b922f658f18360 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:41.775891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:51:41.860441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:41.887978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acde00-f772-4c58-b3d9-5c78f75e6844 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:51:41.923939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce539-951d-49f9-873f-3c95a5f1d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:51:41.924525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce539-951d-49f9-873f-3c95a5f1d904 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:51:41.924795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce539-951d-49f9-873f-3c95a5f1d904 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:51:41.925087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce539-951d-49f9-873f-3c95a5f1d904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:51:41.925803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce539-951d-49f9-873f-3c95a5f1d904 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=bb3aa254f6914fffa3b922f658f18360, user.id=4f9ed226c7874ea981faa25ca78432c0) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:51:41.926101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce539-951d-49f9-873f-3c95a5f1d904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:51:41.927530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce539-951d-49f9-873f-3c95a5f1d904 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:51:41.933579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 602/1200] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:51:41 2022] GET /identity/v3/role_assignments?user.id=4f9ed226c7874ea981faa25ca78432c0&scope.project.id=bb3aa254f6914fffa3b922f658f18360&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:51:51.758704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:51:51.930851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=30 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:37.752820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d753-424e-4150-8b54-b862ff6c38b9 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:37.753447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d753-424e-4150-8b54-b862ff6c38b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:37.753540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d753-424e-4150-8b54-b862ff6c38b9 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:37.755300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 599/1201] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:52:37.761234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2500c1-5ec8-4d35-bdbe-2c8b82b84f20 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:37.761943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2500c1-5ec8-4d35-bdbe-2c8b82b84f20 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:37.761943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2500c1-5ec8-4d35-bdbe-2c8b82b84f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:37.784741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9b2500c1-5ec8-4d35-bdbe-2c8b82b84f20 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:52:37.786391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b2500c1-5ec8-4d35-bdbe-2c8b82b84f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:52:37.876868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 603/1202] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:52:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:52:38.162433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9d753-424e-4150-8b54-b862ff6c38b9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:38.313238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9d753-424e-4150-8b54-b862ff6c38b9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:38.354234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:38.354885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:38.355165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:38.355502 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:38.369139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:38.370611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:38.387916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:38.389586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:38.391075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:38.391075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:38.391075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:38.395527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 600/1203] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:52:38.395680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2500c1-5ec8-4d35-bdbe-2c8b82b84f20 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:38.527714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2500c1-5ec8-4d35-bdbe-2c8b82b84f20 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:38.567581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:38.575311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35489129-8cac-4283-92be-136da3ca6092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:38.576474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489129-8cac-4283-92be-136da3ca6092 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:38.577044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489129-8cac-4283-92be-136da3ca6092 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:38.577650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489129-8cac-4283-92be-136da3ca6092 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:38.578331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35489129-8cac-4283-92be-136da3ca6092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:38.578788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35489129-8cac-4283-92be-136da3ca6092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:38.580330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35489129-8cac-4283-92be-136da3ca6092 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:38.595514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 604/1204] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:38.601879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:38.672956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:38.735000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de132-fe9a-4c84-b42c-7f49d526ea3e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:38.788123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d53861-1c88-4128-a7cb-b16173abd564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:38.788835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53861-1c88-4128-a7cb-b16173abd564 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:38.788980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53861-1c88-4128-a7cb-b16173abd564 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:38.789257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53861-1c88-4128-a7cb-b16173abd564 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:38.789969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d53861-1c88-4128-a7cb-b16173abd564 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:38.791446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d53861-1c88-4128-a7cb-b16173abd564 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:38.824839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 601/1205] 10.222.0.89 () {60 vars in 1132 bytes} [Tue Aug 30 00:52:38 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:52:40.937093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a04c08-1d79-4446-939d-5418cd3288ef None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:40.937669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a04c08-1d79-4446-939d-5418cd3288ef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:40.937669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a04c08-1d79-4446-939d-5418cd3288ef None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:40.939170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 605/1206] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:52:40.945858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20786-3791-4bac-bd69-d8cfda2de97b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:40.946393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20786-3791-4bac-bd69-d8cfda2de97b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:40.946847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20786-3791-4bac-bd69-d8cfda2de97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:40.972047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2db20786-3791-4bac-bd69-d8cfda2de97b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:52:40.973446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2db20786-3791-4bac-bd69-d8cfda2de97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:52:41.050498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 602/1207] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:52:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:52:41.335636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a04c08-1d79-4446-939d-5418cd3288ef None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:41.454447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a04c08-1d79-4446-939d-5418cd3288ef None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:41.492075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:41.492694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:41.493050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:41.493326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:41.504013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:52:41.509335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:41.510543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:41.511380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 606/1208] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:41.516978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db20786-3791-4bac-bd69-d8cfda2de97b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:41.560583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:41.631508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db20786-3791-4bac-bd69-d8cfda2de97b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:41.678015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:41.678805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:41.679120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:41.679508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:41.680338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:41.680710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:41.682340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:41.692460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 603/1209] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:52:41.697083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:41.764652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:41.840091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf14b-a6ac-46f5-9cba-d757d5dc1075 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:41.883567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:41.883567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:41.883567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:41.883567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:41.895249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:41.897387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:41.913060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:41.914070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:41.915119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:41.915119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:41.915119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:41.915119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 607/1210] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:52:41.920426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:42.029260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:42.032509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d2a77-a764-423e-bd00-61399483c04c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:42.084572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:42.085241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:42.085519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:42.085809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:42.086474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:42.086788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:42.088237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:42.103097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 604/1211] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:42.109776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:42.215438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c9206-7947-485a-b00c-be254ab9cd70 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:42.217239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:42.267203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:42.268165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:42.268444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:42.268884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:42.277395 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:42.278859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:52:42.293970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:42.295265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:42.296425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:42.300485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 608/1212] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:52:42.302320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:42.426396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c0f84-2e46-4082-9cfc-562a020e0833 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:42.466895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:42.467260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:42.467619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:42.467981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:42.468844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:42.469484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:42.471389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:42.496085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 605/1213] 10.222.0.89 () {56 vars in 1143 bytes} [Tue Aug 30 00:52:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:42.502773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:42.631485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb916-9287-4447-8f87-3542956c549f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:42.674676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:42.675318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:42.675626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:42.676080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:42.717259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:42.769312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:42.771394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:42.897556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 609/1214] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:52:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:52:42.903767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:42.929756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:43.030246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534857d-8742-4b2e-96d4-5ae289b1e510 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:43.070089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:43.070753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:43.071028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:43.071294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:43.081465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:43.083396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:43.099748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:43.101013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:43.102111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:43.102111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:43.102111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:43.102111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 606/1215] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:43.109408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:43.188624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:43.242435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf203aa-9a3b-4017-b06c-1f17fdd39957 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:43.287229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:43.287790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:43.288068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:43.288358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:43.289017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:43.289314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:43.290749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:43.304149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 610/1216] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:43.309716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:43.385835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:43.418532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6d80-ccb4-414c-89b6-7eacc4e72c7e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:43.458729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:43.459583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:43.459897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:43.460262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:43.469095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:43.470537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:52:43.483153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:43.484167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:43.485604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 607/1217] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:52:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:43.491506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:43.604442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1c6bc-c195-465c-b1ad-469e3c69ddf1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:43.628458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:43.644600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11af55-a874-45aa-9859-86e146800e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:43.645228 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11af55-a874-45aa-9859-86e146800e8f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:43.645492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11af55-a874-45aa-9859-86e146800e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:43.645765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11af55-a874-45aa-9859-86e146800e8f None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:43.646549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11af55-a874-45aa-9859-86e146800e8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:43.646830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11af55-a874-45aa-9859-86e146800e8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:43.648367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11af55-a874-45aa-9859-86e146800e8f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:43.662861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 611/1218] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:43.669150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:43.781838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4ee92-0ed3-498c-bdf7-62d73a53d9a7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:43.817835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:43.826005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa9af1-56ce-4047-8d36-3c7a98d8b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:43.826005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9af1-56ce-4047-8d36-3c7a98d8b76b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:43.826266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9af1-56ce-4047-8d36-3c7a98d8b76b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:43.826342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9af1-56ce-4047-8d36-3c7a98d8b76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:43.827061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa9af1-56ce-4047-8d36-3c7a98d8b76b None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=28a10c7731a84a4589c366c4963c1251) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:43.827387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa9af1-56ce-4047-8d36-3c7a98d8b76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:43.828788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa9af1-56ce-4047-8d36-3c7a98d8b76b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:43.835347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 608/1219] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:52:43 2022] GET /identity/v3/role_assignments?user.id=28a10c7731a84a4589c366c4963c1251&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:52:45.810681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39787d-44e7-466a-a94c-fd15b0169ab7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:45.811245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39787d-44e7-466a-a94c-fd15b0169ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:45.811245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39787d-44e7-466a-a94c-fd15b0169ab7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:45.812536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 612/1220] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:52:45.818002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc2f91-5948-4a72-874c-fbd8f4ee0f8d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:45.818457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc2f91-5948-4a72-874c-fbd8f4ee0f8d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:45.818550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc2f91-5948-4a72-874c-fbd8f4ee0f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:45.837348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-56bc2f91-5948-4a72-874c-fbd8f4ee0f8d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:52:45.838595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-56bc2f91-5948-4a72-874c-fbd8f4ee0f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:52:45.910450 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 609/1221] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:52:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:52:46.185766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39787d-44e7-466a-a94c-fd15b0169ab7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:46.311479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39787d-44e7-466a-a94c-fd15b0169ab7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:46.349301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:46.350001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:46.350335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:46.350646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:46.362086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:52:46.368118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:46.369298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:46.370254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 613/1222] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:46.376643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc2f91-5948-4a72-874c-fbd8f4ee0f8d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:46.482501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc2f91-5948-4a72-874c-fbd8f4ee0f8d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:46.506651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:46.518621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:46.519372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:46.519750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:46.520171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:46.520985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:46.521284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:46.522736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:46.531808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 610/1223] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:52:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:46.538260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:46.589323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:46.660136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7be81c-42f3-4298-b413-30fa61b69175 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:46.698738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:46.699369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:46.699643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:46.699906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:46.710938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:46.712435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:46.727837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:46.729123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:46.730415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:46.730415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:46.730415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:46.730415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 614/1224] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:46.736334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:46.845719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6069d42-a9de-48f6-b290-7e0c9be55d7c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:46.882361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:46.882970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:46.883220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:46.883510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:46.884202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:46.884540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:46.886171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:46.899058 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 611/1225] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:46.904887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:47.023586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:47.031764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cb4f5-3c04-4b33-907a-2cca7489c6eb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:47.071621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:47.072260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:47.072529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:47.072791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:47.080735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:47.082612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:52:47.095590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:47.096673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:47.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 615/1226] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:47.103419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:47.156078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:47.219413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d63506-c5b9-4a8b-877c-2c9f4c1e128b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:47.264198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:47.264874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:47.265157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:47.265436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:47.266223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:47.266560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:47.268018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:47.286824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 612/1227] 10.222.0.89 () {56 vars in 1143 bytes} [Tue Aug 30 00:52:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:47.293604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:47.413120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef61a-bb83-4feb-b878-3c1cbcb6f864 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:47.451587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:47.452272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:47.452550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:47.452851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:47.465106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:47.466556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:47.484137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:47.485529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:47.486445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:47.486445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:47.486445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:47.486445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 616/1228] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:47.492186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:47.600855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b621aa1-8430-4c92-960a-43cca66744d8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:47.603381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:47.641037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:47.641780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:47.642097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:47.642448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:47.643164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:47.643486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:47.645151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:47.657676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 613/1229] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:47.664047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:47.678263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:47.785505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e1a2e-f0dd-471f-ae50-534f8741dd0e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:47.824091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:47.824713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:47.825027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:47.825294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:47.832002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:47.833757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:52:47.847795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:47.849095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:47.850166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 617/1230] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:52:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:47.855676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:47.967590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf63db-b5b9-49a5-a54a-880be0b88289 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:48.010697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e0185-cd22-4300-8a0e-07c34fcc9c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:48.012222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0185-cd22-4300-8a0e-07c34fcc9c3a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:48.012222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0185-cd22-4300-8a0e-07c34fcc9c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:48.012222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0185-cd22-4300-8a0e-07c34fcc9c3a None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:48.012713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e0185-cd22-4300-8a0e-07c34fcc9c3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:48.013037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e0185-cd22-4300-8a0e-07c34fcc9c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:48.014461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e0185-cd22-4300-8a0e-07c34fcc9c3a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:48.027556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 614/1231] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:52:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:48.033838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:48.106171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:48.146134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc361fd-4c72-4190-b5f7-f77af8862bae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:48.186797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44996455-3366-4b4f-ad52-d277bbd229d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:48.187460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44996455-3366-4b4f-ad52-d277bbd229d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:48.187738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44996455-3366-4b4f-ad52-d277bbd229d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:48.188001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44996455-3366-4b4f-ad52-d277bbd229d1 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/28a10c7731a84a4589c366c4963c1251/roles/33333e39653f4ee589cbae8b5422ddc8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:48.204731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44996455-3366-4b4f-ad52-d277bbd229d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=28a10c7731a84a4589c366c4963c1251, role_id=33333e39653f4ee589cbae8b5422ddc8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:48.206465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44996455-3366-4b4f-ad52-d277bbd229d1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:48.219448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 618/1232] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:52:48 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/28a10c7731a84a4589c366c4963c1251/roles/33333e39653f4ee589cbae8b5422ddc8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:52:50.171660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c34e88-10f6-4ae6-9a39-72f53dc589dd None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:50.172171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c34e88-10f6-4ae6-9a39-72f53dc589dd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:50.172171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c34e88-10f6-4ae6-9a39-72f53dc589dd None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:50.173674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 615/1233] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:52:50.178999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4169-ccb6-4a16-848d-f9bb5a7175d0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:50.179405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4169-ccb6-4a16-848d-f9bb5a7175d0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:50.179585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4169-ccb6-4a16-848d-f9bb5a7175d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:50.200703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-861b4169-ccb6-4a16-848d-f9bb5a7175d0 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:52:50.201937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-861b4169-ccb6-4a16-848d-f9bb5a7175d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:52:50.288408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 619/1234] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:52:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:52:50.558733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c34e88-10f6-4ae6-9a39-72f53dc589dd None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:50.587202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:50.677225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c34e88-10f6-4ae6-9a39-72f53dc589dd None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:50.716768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:50.717430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:50.717763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:50.718102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:50.729475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:52:50.734309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:50.735388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:50.736636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 616/1235] 10.222.0.89 () {56 vars in 1102 bytes} [Tue Aug 30 00:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:52:50.742128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4169-ccb6-4a16-848d-f9bb5a7175d0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:50.793658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:50.861446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4169-ccb6-4a16-848d-f9bb5a7175d0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:50.907222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:50.908241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:50.908716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:50.909232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:50.911488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:50.912022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:50.914582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:50.924494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 620/1236] 10.222.0.89 () {56 vars in 1103 bytes} [Tue Aug 30 00:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:50.931073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:51.020083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:51.039474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436fdb9-66f3-43b5-8d84-53e67c0d6cb5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:51.080389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:51.081049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:51.081324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:51.081602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:51.092312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:51.093965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:51.110001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:51.111009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:51.117977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:51.117977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:51.117977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:51.117977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 617/1237] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:51.118334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:51.240000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c360b-d612-46ba-b9c5-31427775151c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:51.256242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:51.292017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:51.292944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:51.293311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:51.293710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:51.294601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:51.295106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:51.297006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:51.310101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 621/1238] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:51.317091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:51.430158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9ecc-d4ff-4c96-a65f-b7b76002c23c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:51.467949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:51.468704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:51.469071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:51.469341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:51.472440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:51.479349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:51.481309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:52:51.494434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:51.495571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:51.497139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 618/1239] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:51.503889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:51.613317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255cb0b-a358-4f4e-bd59-206e57c10d6d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:51.653811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:51.654453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:51.654723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:51.654996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:51.655749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:51.656051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:51.657568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:51.676661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 622/1240] 10.222.0.89 () {56 vars in 1143 bytes} [Tue Aug 30 00:52:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:52:51.683513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:51.805182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47e50-1fc1-4321-b7d7-024d284ff9ba None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:51.847534 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:51.848525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:51.848857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:51.849136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:51.914949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:51.923010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:51.924568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:52.036725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 619/1241] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:52:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:52:52.043414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:52.076454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:52.158191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e22a-8d2d-4ffd-9c76-15520a722b9b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:52.200610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:52.201264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:52.201539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:52.201808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:52.213708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:52.215169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:52.235264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:52.236447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:52.237534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:52.237534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:52.237534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:52.237534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 623/1242] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:52:52.244127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:52.356708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:52.363932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96032-eca6-4744-b6fc-d968b5d59553 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:52.403361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:52.404085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:52.404394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:52.404773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:52.405541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:52.405967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:52.407419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:52.420512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 620/1243] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:52:52.426897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:52.511586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:52.534304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3518d-bdce-4fb8-b0ba-25c3f76d3527 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:52.569791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:52.570424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:52.570703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:52.570974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:52.578329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:52.579833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:52:52.592214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:52.593462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:52.594514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 624/1244] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:52.599847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:52.708284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d20fe0-938e-416e-80cc-4e3c27119e66 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:52.742625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17659d-0c1e-4b07-a088-f9c879321a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:52.743271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17659d-0c1e-4b07-a088-f9c879321a99 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:52.743585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17659d-0c1e-4b07-a088-f9c879321a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:52.743779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17659d-0c1e-4b07-a088-f9c879321a99 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:52.744477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17659d-0c1e-4b07-a088-f9c879321a99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:52.744784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17659d-0c1e-4b07-a088-f9c879321a99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:52.746291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17659d-0c1e-4b07-a088-f9c879321a99 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:52.761921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 621/1245] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:52:52.768093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:52.879611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4a0e1-74d9-4338-ae9d-cca5c98edc19 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:52.920141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ac9e-353f-4c29-a0d6-1569afd67667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:52.920748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ac9e-353f-4c29-a0d6-1569afd67667 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:52.921054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ac9e-353f-4c29-a0d6-1569afd67667 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:52.921325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ac9e-353f-4c29-a0d6-1569afd67667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:52.922057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ac9e-353f-4c29-a0d6-1569afd67667 None admin] RBAC: Adding query filter params (role.id=33333e39653f4ee589cbae8b5422ddc8, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=28a10c7731a84a4589c366c4963c1251) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:52.922361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ac9e-353f-4c29-a0d6-1569afd67667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:52.923792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ac9e-353f-4c29-a0d6-1569afd67667 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:52.929629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 625/1246] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:52:52 2022] GET /identity/v3/role_assignments?user.id=28a10c7731a84a4589c366c4963c1251&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=33333e39653f4ee589cbae8b5422ddc8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:54.920108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c8bc-44dd-4c6e-8909-6f96125c9746 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:54.920762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c8bc-44dd-4c6e-8909-6f96125c9746 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:54.920762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c8bc-44dd-4c6e-8909-6f96125c9746 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:54.922044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 622/1247] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:52:54.927602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe559cd-6ef0-4589-82ce-d2e9acfe8b74 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:54.928090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe559cd-6ef0-4589-82ce-d2e9acfe8b74 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:54.928169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe559cd-6ef0-4589-82ce-d2e9acfe8b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:54.935048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:54.948859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4fe559cd-6ef0-4589-82ce-d2e9acfe8b74 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:52:54.950062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4fe559cd-6ef0-4589-82ce-d2e9acfe8b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:52:55.028265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 626/1248] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:52:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:52:55.305345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c8bc-44dd-4c6e-8909-6f96125c9746 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:55.325370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:55.419764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c8bc-44dd-4c6e-8909-6f96125c9746 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:55.457447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:55.458123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:55.458371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:55.458665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:55.471874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:52:55.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:55.478649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:55.479726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 623/1249] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:55.484735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe559cd-6ef0-4589-82ce-d2e9acfe8b74 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:55.597340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe559cd-6ef0-4589-82ce-d2e9acfe8b74 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:55.633819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:55.639284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:55.639930 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:55.640208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:55.640470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:55.641157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:55.641450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:55.642936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:55.652132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 627/1250] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:52:55.658112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:55.756541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:55.787356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265c592-fd99-4996-82f5-64d4856a4828 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:55.838807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:55.839589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:55.840005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:55.840423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:55.857528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:55.859370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:55.882012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:55.883200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:55.884285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:55.884285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:55.884285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:55.884285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 624/1251] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:55.890951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:56.010946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93358-5d24-4698-ae48-7fa232e5302b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:56.049474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:56.050463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:56.050914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:56.051296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:56.051952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:56.052253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:56.053662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:56.069411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 628/1252] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:56.075290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:56.188712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ccf3-459e-4d0c-a80f-30cac55ef539 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:56.218296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:56.227172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:56.227836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:56.228141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:56.228440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:56.238643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:56.241454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:52:56.255732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:56.256995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:52:56.258422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 625/1253] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:56.263195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:56.333687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:56.383283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687c1b2-faab-4878-b626-ea521433017c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:56.421501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:56.422108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:56.422386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:56.422648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:56.423387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:56.423685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:56.425247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:56.444332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 629/1254] 10.222.0.89 () {56 vars in 1143 bytes} [Tue Aug 30 00:52:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:56.450381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:56.566948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812454a9-7ba1-491d-8296-cdc368be48f9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:56.606575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:56.607281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:56.607556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:56.607822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:56.671093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:56.683746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:56.685223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:56.802142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 626/1255] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:52:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:52:56.809808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:56.921904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce73e9-8a64-4eb9-bb39-02db6a5e3f8e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:56.936807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:56.961348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45c85-c887-4392-9428-60859231039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:56.962087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45c85-c887-4392-9428-60859231039e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:56.962367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45c85-c887-4392-9428-60859231039e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:56.962637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45c85-c887-4392-9428-60859231039e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:56.974551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa45c85-c887-4392-9428-60859231039e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:56.976131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa45c85-c887-4392-9428-60859231039e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ffa45c85-c887-4392-9428-60859231039e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:52:56.992428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:56.993653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:52:56.994530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:52:56.994530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:52:56.994530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:56.994530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 630/1256] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:52:57.000592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:57.101718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:57.115892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a807e-6493-423c-9dc0-90b18c081257 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:57.151865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:57.152477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:57.152749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:57.153039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:57.153677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:57.153973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:57.155476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:57.167496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 627/1257] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:57.174239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45c85-c887-4392-9428-60859231039e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:57.288934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45c85-c887-4392-9428-60859231039e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:57.329416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:57.330132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:57.330516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:57.330793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:57.338626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:57.340428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:52:57.354538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:52:57.355802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:52:57.356921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 631/1258] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:52:57.362125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:57.477136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0820-12b3-43e8-bb81-a59bae4dad62 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:57.513895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090f56f-d2b3-4457-b765-749cd929983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:57.514497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090f56f-d2b3-4457-b765-749cd929983d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:57.514769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090f56f-d2b3-4457-b765-749cd929983d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:57.515034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090f56f-d2b3-4457-b765-749cd929983d None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:57.515721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090f56f-d2b3-4457-b765-749cd929983d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:57.516013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090f56f-d2b3-4457-b765-749cd929983d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:57.517520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090f56f-d2b3-4457-b765-749cd929983d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:57.529937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 628/1259] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:57.536892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:57.566758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:52:57.646906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d23cf-f832-477b-a315-9989b0159750 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:52:57.682087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c29ac-cfac-4dc7-9ac0-4479457fd432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:52:57.682689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c29ac-cfac-4dc7-9ac0-4479457fd432 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:57.683013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c29ac-cfac-4dc7-9ac0-4479457fd432 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:57.683279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c29ac-cfac-4dc7-9ac0-4479457fd432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:57.684044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c29ac-cfac-4dc7-9ac0-4479457fd432 None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=28a10c7731a84a4589c366c4963c1251) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:52:57.684369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c29ac-cfac-4dc7-9ac0-4479457fd432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:52:57.685810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c29ac-cfac-4dc7-9ac0-4479457fd432 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:52:57.692244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 632/1260] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:52:57 2022] GET /identity/v3/role_assignments?user.id=28a10c7731a84a4589c366c4963c1251&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=a456b12493c0413b825ef135c49a3338 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:52:59.598643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68f513-3ee6-43de-ad29-d24be8c1613e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:59.599239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68f513-3ee6-43de-ad29-d24be8c1613e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:59.599239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68f513-3ee6-43de-ad29-d24be8c1613e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:59.600503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 629/1261] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:52:59.606808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc7dd-194f-4f75-a0a3-aad7bb8074e6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:52:59.607236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc7dd-194f-4f75-a0a3-aad7bb8074e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:52:59.607344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc7dd-194f-4f75-a0a3-aad7bb8074e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:52:59.633193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b97dc7dd-194f-4f75-a0a3-aad7bb8074e6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:52:59.634413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b97dc7dd-194f-4f75-a0a3-aad7bb8074e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:52:59.708858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 633/1262] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:52:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:52:59.977355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68f513-3ee6-43de-ad29-d24be8c1613e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:52:59.990166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:00.094885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68f513-3ee6-43de-ad29-d24be8c1613e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:00.133101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:00.133728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:00.134002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:00.134270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:00.146967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:00.151739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:00.152923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:53:00.154360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 630/1263] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:00.161334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc7dd-194f-4f75-a0a3-aad7bb8074e6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:00.181295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:00.288148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc7dd-194f-4f75-a0a3-aad7bb8074e6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:00.332472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:00.333106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:00.333382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:00.333654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:00.334320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:00.334622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:00.335991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:00.345121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 634/1264] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:00.351696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:00.427281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:00.476617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d095e6-b6d1-49cf-9405-4463901aa664 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:00.521503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:00.522135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:00.522411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:00.522677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:00.535020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:00.536454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:53:00.553615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:00.554774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:53:00.555857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:53:00.555857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:00.555857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:53:00.555857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 631/1265] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:00.561138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:00.660457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:00.680056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3db57-8d07-4d48-b485-e46da06a863d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:00.715121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:00.715701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:00.715970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:00.716238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:00.716868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:00.717186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:00.718545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:00.731509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 635/1266] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:00.738022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:00.854775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2240-b953-4fba-ba4f-fe4b98015d74 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:00.874702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:00.890070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:00.890699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:00.890974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:00.891243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:00.899822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:00.901292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:53:00.912597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:00.913664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:53:00.914629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 632/1267] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:00.920579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:01.027335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebfa2a-5216-41bc-b90d-703b127ad66c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:01.065947 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:01.066517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:01.066817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:01.067082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:01.067805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:01.068103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:01.069623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:01.079510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:01.088979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 636/1268] 10.222.0.89 () {56 vars in 1143 bytes} [Tue Aug 30 00:53:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:01.094984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:01.202783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6d178-d890-4896-8c46-e716bc440670 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:01.244084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:01.244893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:01.245290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:01.245615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:01.259842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:01.261868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:53:01.279162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:01.280184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:53:01.281333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:53:01.281333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:01.281333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:53:01.281333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 633/1269] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:53:01.287654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:01.391832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2add47-de3d-47c4-b22d-c7641ece0ae3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:01.428822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:01.429430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:01.429705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:01.429968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:01.430599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:01.430893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:01.432249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:01.444702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 637/1270] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:01.451256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:01.493453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:01.575505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589024-d7e4-4ce7-a15b-c462c80bf65c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:01.618330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:01.618947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:01.619223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:01.619493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:01.626445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:01.628066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:53:01.639796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:01.640754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:53:01.641710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 634/1271] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:01.647340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:01.710486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:01.759942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910057c2-35e9-4e3e-ba2a-5793c9d89bc1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:01.800596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48c5ef-9358-4f55-a448-0e786f127702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:01.801228 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c5ef-9358-4f55-a448-0e786f127702 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:01.801502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c5ef-9358-4f55-a448-0e786f127702 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:01.801769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48c5ef-9358-4f55-a448-0e786f127702 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:01.802454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48c5ef-9358-4f55-a448-0e786f127702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:01.802752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48c5ef-9358-4f55-a448-0e786f127702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:01.804172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48c5ef-9358-4f55-a448-0e786f127702 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:01.818066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 638/1272] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:01.825093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:01.935466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:01.945005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4bb66-9ed6-44c4-adc6-46ac7536c9a8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:01.979119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f4cef-41e8-4785-83db-fa2b9cc8c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:01.979776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f4cef-41e8-4785-83db-fa2b9cc8c2c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:01.980051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f4cef-41e8-4785-83db-fa2b9cc8c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:01.980324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f4cef-41e8-4785-83db-fa2b9cc8c2c3 None admin] PATH_INFO: `/v3/projects/05cd95800453446594f4b9b933e9d41a/users/28a10c7731a84a4589c366c4963c1251/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:01.982360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f4cef-41e8-4785-83db-fa2b9cc8c2c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=05cd95800453446594f4b9b933e9d41a, user_id=28a10c7731a84a4589c366c4963c1251, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:01.983789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f4cef-41e8-4785-83db-fa2b9cc8c2c3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:01.999037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 635/1273] 10.222.0.89 () {58 vars in 1439 bytes} [Tue Aug 30 00:53:01 2022] PUT /identity/v3/projects/05cd95800453446594f4b9b933e9d41a/users/28a10c7731a84a4589c366c4963c1251/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:53:03.877684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e539f-6740-42e0-8a21-a1d15f199698 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:03.878839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e539f-6740-42e0-8a21-a1d15f199698 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:03.879181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e539f-6740-42e0-8a21-a1d15f199698 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:03.881207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 639/1274] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:53:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:03.889141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c70ea-f91e-4b74-94ea-f8a5739f0dc1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:03.889581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c70ea-f91e-4b74-94ea-f8a5739f0dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:03.889701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c70ea-f91e-4b74-94ea-f8a5739f0dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:03.910313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fd5c70ea-f91e-4b74-94ea-f8a5739f0dc1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:03.911500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fd5c70ea-f91e-4b74-94ea-f8a5739f0dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:03.982238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 636/1275] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:53:04.259356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e539f-6740-42e0-8a21-a1d15f199698 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:04.371857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e539f-6740-42e0-8a21-a1d15f199698 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:04.390644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:04.410686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:04.411220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:04.411495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:04.411760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:04.422766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:04.428323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:04.429354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:04.430214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 640/1276] 10.222.0.89 () {56 vars in 1096 bytes} [Tue Aug 30 00:53:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:04.436423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c70ea-f91e-4b74-94ea-f8a5739f0dc1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:04.542664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:04.563228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c70ea-f91e-4b74-94ea-f8a5739f0dc1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:04.598356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:04.598960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:04.599230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:04.599503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:04.600168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:04.600461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:04.601851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:04.610755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 637/1277] 10.222.0.89 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:04.620346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:04.724163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17309256-66eb-4c0c-bf34-6448c6e34de3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:04.762608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:04.763233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:04.763588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:04.763759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:04.774853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:04.776286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:53:04.791853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:04.793011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:53:04.794284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:53:04.794284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:04.794284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:04.794284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 641/1278] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:04.799587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:04.923725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53a53-33bd-49e6-a3ba-e51ecd963fec None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:04.965988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:04.966862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:04.967205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:04.967555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:04.968488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:04.968882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:04.970999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:04.989373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 638/1279] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:04.998510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:05.034316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:05.104123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68d250-0285-41e6-847c-885e1fcc592d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:05.137990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:05.138606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:05.138878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:05.139141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:05.146644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:05.148079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:53:05.159004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:05.160040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:05.161693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 642/1280] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:05.169818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:05.175962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:05.291199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c4376-aecb-4f93-a69f-4b0427730980 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:05.329811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:05.330466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:05.330776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:05.331133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:05.332108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:05.332448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:05.334160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:05.353703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 639/1281] 10.222.0.89 () {56 vars in 1143 bytes} [Tue Aug 30 00:53:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:05.363527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:05.464356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:05.476503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3f2f9-35d1-4044-90cc-f18df819e1a9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:05.515052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:05.515652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:05.515926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:05.516191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:05.590114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:05.591569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:05.683909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:05.696088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 643/1282] 10.222.0.89 () {58 vars in 1282 bytes} [Tue Aug 30 00:53:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:53:05.702530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:05.769037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:05.809165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f5180-bb3c-4cf4-8827-5e15f766b649 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:05.845196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:05.845831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:05.846108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:05.846439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:05.857144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:05.858607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:53:05.873898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:05.875037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:53:05.875989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:53:05.875989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:05.875989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:53:05.875989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 640/1283] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:05.883800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:05.989167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbfca3-6bc8-4e3f-8885-cd400c83a8b2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:06.027257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:06.027848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:06.028101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:06.028364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:06.029026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:06.029320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:06.030681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:06.042335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 644/1284] 10.222.0.89 () {56 vars in 1109 bytes} [Tue Aug 30 00:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:06.048279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:06.154304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1e23-8d35-453c-9b3f-d6fe3a1dca38 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:06.168101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:06.190612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:06.191234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:06.191505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:06.191766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:06.198994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:06.200567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:53:06.213198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:06.214242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Aug 30 00:53:06.215670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 641/1285] 10.222.0.89 () {56 vars in 1111 bytes} [Tue Aug 30 00:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:06.223862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:06.291683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:06.346192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf713177-1240-420a-924d-74a81b022f26 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:06.382634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b82cd-d1c2-4023-b69b-d5b680be1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:06.383248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b82cd-d1c2-4023-b69b-d5b680be1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:06.383519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b82cd-d1c2-4023-b69b-d5b680be1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:06.383754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b82cd-d1c2-4023-b69b-d5b680be1dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:06.384471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b82cd-d1c2-4023-b69b-d5b680be1dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:06.384769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b82cd-d1c2-4023-b69b-d5b680be1dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:06.386261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b82cd-d1c2-4023-b69b-d5b680be1dd5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:06.398379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 645/1286] 10.222.0.89 () {56 vars in 1148 bytes} [Tue Aug 30 00:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:06.408529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:06.519711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ce858-b3f6-4186-b4e7-3dacb9dc35f3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:06.564273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a0897-c2e7-4aef-9c7d-30ff3a64dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:06.565187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a0897-c2e7-4aef-9c7d-30ff3a64dd6c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:06.565645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a0897-c2e7-4aef-9c7d-30ff3a64dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:06.566135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a0897-c2e7-4aef-9c7d-30ff3a64dd6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:06.567220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a0897-c2e7-4aef-9c7d-30ff3a64dd6c None admin] RBAC: Adding query filter params (role.id=a456b12493c0413b825ef135c49a3338, scope.project.id=05cd95800453446594f4b9b933e9d41a, user.id=28a10c7731a84a4589c366c4963c1251) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:06.567726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a0897-c2e7-4aef-9c7d-30ff3a64dd6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:06.570103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a0897-c2e7-4aef-9c7d-30ff3a64dd6c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:06.580463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 642/1287] 10.222.0.89 () {56 vars in 1374 bytes} [Tue Aug 30 00:53:06 2022] GET /identity/v3/role_assignments?user.id=28a10c7731a84a4589c366c4963c1251&scope.project.id=05cd95800453446594f4b9b933e9d41a&role.id=a456b12493c0413b825ef135c49a3338 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:08.529245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2ce8b-0422-4f26-907d-692130762a9e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:08.530183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2ce8b-0422-4f26-907d-692130762a9e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:08.530183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2ce8b-0422-4f26-907d-692130762a9e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:08.532344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 646/1288] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:08.540970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72571b5d-6dfb-450a-91e5-8de2fa88eeaf None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:08.541448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72571b5d-6dfb-450a-91e5-8de2fa88eeaf None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:08.541543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72571b5d-6dfb-450a-91e5-8de2fa88eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:08.563138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-72571b5d-6dfb-450a-91e5-8de2fa88eeaf None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:08.564339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-72571b5d-6dfb-450a-91e5-8de2fa88eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:08.599115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:08.640249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 643/1289] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:53:08.912216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2ce8b-0422-4f26-907d-692130762a9e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:09.023164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2ce8b-0422-4f26-907d-692130762a9e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:09.034301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:09.059647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:09.060304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:09.060578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:09.060847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:09.061451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:09.062854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:09.071831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:09.073118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:09.073974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 647/1290] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:53:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:09.079256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72571b5d-6dfb-450a-91e5-8de2fa88eeaf None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:09.199892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72571b5d-6dfb-450a-91e5-8de2fa88eeaf None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:09.236609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127fb2-ce19-4d24-8c5e-31e1a70c0c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:09.237699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127fb2-ce19-4d24-8c5e-31e1a70c0c81 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:09.237978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127fb2-ce19-4d24-8c5e-31e1a70c0c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:09.238235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127fb2-ce19-4d24-8c5e-31e1a70c0c81 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:09.238878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6127fb2-ce19-4d24-8c5e-31e1a70c0c81 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:09.239172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6127fb2-ce19-4d24-8c5e-31e1a70c0c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:09.240677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6127fb2-ce19-4d24-8c5e-31e1a70c0c81 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:09.245650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 644/1291] 10.222.0.89 () {56 vars in 1116 bytes} [Tue Aug 30 00:53:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:09.255169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:09.387459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b920292-92f0-4d71-85f5-5a8bb66a1d9c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:09.430534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b16cd5-a614-4398-b4a8-0b2ad021bfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:09.431376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16cd5-a614-4398-b4a8-0b2ad021bfff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:09.431736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16cd5-a614-4398-b4a8-0b2ad021bfff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:09.432039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16cd5-a614-4398-b4a8-0b2ad021bfff None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:09.432989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16cd5-a614-4398-b4a8-0b2ad021bfff None admin] RBAC: Adding query filter params (type=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:09.433373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16cd5-a614-4398-b4a8-0b2ad021bfff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:09.435479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16cd5-a614-4398-b4a8-0b2ad021bfff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:09.443093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 648/1292] 10.222.0.89 () {56 vars in 1116 bytes} [Tue Aug 30 00:53:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:11.315883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95e561-9214-4c78-a0d8-30f9dc5b8a21 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:11.316471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95e561-9214-4c78-a0d8-30f9dc5b8a21 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:11.316471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95e561-9214-4c78-a0d8-30f9dc5b8a21 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:11.317810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 645/1293] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:11.324267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dca9e7-3553-48d5-9ad2-f9330b43e94e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:11.325128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dca9e7-3553-48d5-9ad2-f9330b43e94e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:11.325283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dca9e7-3553-48d5-9ad2-f9330b43e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:11.353039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d3dca9e7-3553-48d5-9ad2-f9330b43e94e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:11.354224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d3dca9e7-3553-48d5-9ad2-f9330b43e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:11.388101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:11.429243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 649/1294] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:53:11.694386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95e561-9214-4c78-a0d8-30f9dc5b8a21 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:11.732181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:11.830477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95e561-9214-4c78-a0d8-30f9dc5b8a21 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:11.873139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2098d0-02e5-46cf-b7f7-1fd6d8ab6c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:11.873746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2098d0-02e5-46cf-b7f7-1fd6d8ab6c70 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:11.874021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2098d0-02e5-46cf-b7f7-1fd6d8ab6c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:11.874293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2098d0-02e5-46cf-b7f7-1fd6d8ab6c70 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:11.874943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2098d0-02e5-46cf-b7f7-1fd6d8ab6c70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:11.876300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2098d0-02e5-46cf-b7f7-1fd6d8ab6c70 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:11.898855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 646/1295] 10.222.0.89 () {60 vars in 1141 bytes} [Tue Aug 30 00:53:11 2022] POST /identity/v3/services => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:13.836002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638c1c-0c75-476f-9d44-ace5d617d233 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:13.836584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638c1c-0c75-476f-9d44-ace5d617d233 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:13.836584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638c1c-0c75-476f-9d44-ace5d617d233 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:13.837948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 650/1296] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:13.843394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207bee-6a9b-4259-b083-27df9694359e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:13.843826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207bee-6a9b-4259-b083-27df9694359e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:13.843945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207bee-6a9b-4259-b083-27df9694359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:13.865171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fc207bee-6a9b-4259-b083-27df9694359e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:13.866352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fc207bee-6a9b-4259-b083-27df9694359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:13.942790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 647/1297] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:53:14.204409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638c1c-0c75-476f-9d44-ace5d617d233 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:14.328665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638c1c-0c75-476f-9d44-ace5d617d233 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:14.365067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:14.365674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:14.365945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:14.366201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:14.366777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:14.368138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:14.377260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:14.378371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:14.379241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 651/1298] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:53:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:14.387339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207bee-6a9b-4259-b083-27df9694359e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:14.413953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:14.510941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207bee-6a9b-4259-b083-27df9694359e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:14.546861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:14.547469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:14.547749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:14.548009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:14.548631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:14.549010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:14.550365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:14.556082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 648/1299] 10.222.0.89 () {56 vars in 1116 bytes} [Tue Aug 30 00:53:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:14.562577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:14.602015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:14.682180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df02cc-8805-4969-b45e-6855da05ffe5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:14.718157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6de29-90e1-4700-bde6-f04dd051e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:14.718752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6de29-90e1-4700-bde6-f04dd051e70a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:14.719026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6de29-90e1-4700-bde6-f04dd051e70a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:14.719291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6de29-90e1-4700-bde6-f04dd051e70a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:14.719989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6de29-90e1-4700-bde6-f04dd051e70a None admin] RBAC: Adding query filter params (interface=public, service_id=ebb71cc9a83947cea58c007e806b8690, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:14.720288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6de29-90e1-4700-bde6-f04dd051e70a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:14.721972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6de29-90e1-4700-bde6-f04dd051e70a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:14.727587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 652/1300] 10.222.0.89 () {56 vars in 1251 bytes} [Tue Aug 30 00:53:14 2022] GET /identity/v3/endpoints?service_id=ebb71cc9a83947cea58c007e806b8690&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:14.733655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:14.823142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:14.846046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bdb83-0e6f-45f5-8ede-81dce68692ad None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:14.882150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6dcc-e0b8-4eb6-9715-2a4165b4b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:14.882753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6dcc-e0b8-4eb6-9715-2a4165b4b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:14.883131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6dcc-e0b8-4eb6-9715-2a4165b4b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:14.883426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6dcc-e0b8-4eb6-9715-2a4165b4b5d6 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:14.884024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6dcc-e0b8-4eb6-9715-2a4165b4b5d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:14.885418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6dcc-e0b8-4eb6-9715-2a4165b4b5d6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:14.892240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 649/1301] 10.222.0.89 () {56 vars in 1087 bytes} [Tue Aug 30 00:53:14 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:53:16.763991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a12e51-aae8-459c-a2de-6c3acd410fc0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:16.764701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a12e51-aae8-459c-a2de-6c3acd410fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:16.764854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a12e51-aae8-459c-a2de-6c3acd410fc0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:16.767040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 653/1302] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:53:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:16.772573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c81f3-5ac6-43c2-a266-77d3eda711db None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:16.773076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c81f3-5ac6-43c2-a266-77d3eda711db None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:16.773170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c81f3-5ac6-43c2-a266-77d3eda711db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:16.792542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-db1c81f3-5ac6-43c2-a266-77d3eda711db None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:16.793807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-db1c81f3-5ac6-43c2-a266-77d3eda711db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:16.878740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 650/1303] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:53:17.147416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a12e51-aae8-459c-a2de-6c3acd410fc0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:17.261440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:17.269911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a12e51-aae8-459c-a2de-6c3acd410fc0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:17.309690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:17.310301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:17.310601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:17.310850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:17.311426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:17.312787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:17.321938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:17.323076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Aug 30 00:53:17.324155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 654/1304] 10.222.0.89 () {56 vars in 1117 bytes} [Tue Aug 30 00:53:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:17.329288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c81f3-5ac6-43c2-a266-77d3eda711db None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:17.410804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:17.436827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c81f3-5ac6-43c2-a266-77d3eda711db None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:17.472647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6adfce-c816-4d70-abac-acaedee34b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:17.473290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6adfce-c816-4d70-abac-acaedee34b3e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:17.473568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6adfce-c816-4d70-abac-acaedee34b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:17.473841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6adfce-c816-4d70-abac-acaedee34b3e None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:17.474486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6adfce-c816-4d70-abac-acaedee34b3e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:17.474785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6adfce-c816-4d70-abac-acaedee34b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:17.476155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6adfce-c816-4d70-abac-acaedee34b3e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:17.481642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 651/1305] 10.222.0.89 () {56 vars in 1116 bytes} [Tue Aug 30 00:53:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:17.488896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:17.612301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07ca4-bcbb-48fd-afba-f0f0573e5c3d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:17.651896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc84dd-d67b-4d3c-ae52-31e48fbb3ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:17.652483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc84dd-d67b-4d3c-ae52-31e48fbb3ff1 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:17.652756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc84dd-d67b-4d3c-ae52-31e48fbb3ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:17.653086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc84dd-d67b-4d3c-ae52-31e48fbb3ff1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:17.653741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc84dd-d67b-4d3c-ae52-31e48fbb3ff1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:17.655112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc84dd-d67b-4d3c-ae52-31e48fbb3ff1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:17.679640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 655/1306] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:53:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:27.478495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=30 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:27.674882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.521291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803582e-2ab5-41ad-ba78-8554963465cf None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.522422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803582e-2ab5-41ad-ba78-8554963465cf None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.522898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803582e-2ab5-41ad-ba78-8554963465cf None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.524789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 652/1307] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:22.530292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b7c5-0ab2-4b77-8a7c-6ff641d30e75 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.531167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b7c5-0ab2-4b77-8a7c-6ff641d30e75 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.531712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b7c5-0ab2-4b77-8a7c-6ff641d30e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.621122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b365b7c5-0ab2-4b77-8a7c-6ff641d30e75 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:22.622502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b365b7c5-0ab2-4b77-8a7c-6ff641d30e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:22.774044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 656/1308] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:23.075962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45f0f4-62d9-4c26-9a5d-1093793036e6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.076291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45f0f4-62d9-4c26-9a5d-1093793036e6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.076968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45f0f4-62d9-4c26-9a5d-1093793036e6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:23.078996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 653/1309] 10.222.0.89 () {54 vars in 965 bytes} [Tue Aug 30 00:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:23.085999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b148-902e-4172-87b9-15143d9b56c2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.086290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b148-902e-4172-87b9-15143d9b56c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.086574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861b148-902e-4172-87b9-15143d9b56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:23.172346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6861b148-902e-4172-87b9-15143d9b56c2 None None] MFA Rules not processed for user `5007fe05c96e468b9dbc9b22ff1e2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:23.173788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6861b148-902e-4172-87b9-15143d9b56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:23.199059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:23.270158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 657/1310] 10.222.0.89 () {58 vars in 1062 bytes} [Tue Aug 30 00:54:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:23.278953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45f0f4-62d9-4c26-9a5d-1093793036e6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:23.281123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ca45f0f4-62d9-4c26-9a5d-1093793036e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:23.421895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45f0f4-62d9-4c26-9a5d-1093793036e6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:23.512948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fdd53-8938-4dee-a366-084aec5387b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:23.514196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fdd53-8938-4dee-a366-084aec5387b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.514726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fdd53-8938-4dee-a366-084aec5387b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.515319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fdd53-8938-4dee-a366-084aec5387b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:23.517234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-832fdd53-8938-4dee-a366-084aec5387b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:23.586802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:23.652660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fdd53-8938-4dee-a366-084aec5387b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:23.654294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fdd53-8938-4dee-a366-084aec5387b8 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:23.676862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 654/1311] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:25.915855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b191-c035-49c2-9f8f-e68b040d6b5f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.916386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b191-c035-49c2-9f8f-e68b040d6b5f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.916386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b191-c035-49c2-9f8f-e68b040d6b5f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.917683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 658/1312] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:25.923053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef320-65e1-4335-9dde-6763d2577cfe None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.923506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef320-65e1-4335-9dde-6763d2577cfe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.923600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef320-65e1-4335-9dde-6763d2577cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:26.015392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2beef320-65e1-4335-9dde-6763d2577cfe None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:26.016683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2beef320-65e1-4335-9dde-6763d2577cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:26.133572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 655/1313] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:26.433458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43601f7-88ac-4745-b672-cd22ceea8bc8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:26.433620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43601f7-88ac-4745-b672-cd22ceea8bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:26.433914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43601f7-88ac-4745-b672-cd22ceea8bc8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:26.435238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 659/1314] 10.222.0.89 () {54 vars in 965 bytes} [Tue Aug 30 00:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:26.442603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d801f43-bab8-4c78-a442-587372c7859d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:26.442892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d801f43-bab8-4c78-a442-587372c7859d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:26.443162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d801f43-bab8-4c78-a442-587372c7859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:26.455972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:26.521167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0d801f43-bab8-4c78-a442-587372c7859d None None] MFA Rules not processed for user `5007fe05c96e468b9dbc9b22ff1e2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:26.522371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0d801f43-bab8-4c78-a442-587372c7859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:26.606515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 656/1315] 10.222.0.89 () {58 vars in 1062 bytes} [Tue Aug 30 00:54:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:54:26.617404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43601f7-88ac-4745-b672-cd22ceea8bc8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:26.619071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f43601f7-88ac-4745-b672-cd22ceea8bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:26.734707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43601f7-88ac-4745-b672-cd22ceea8bc8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:26.814676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:26.818871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1900df-f2c4-41ce-9681-498677232fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:26.819702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1900df-f2c4-41ce-9681-498677232fff service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:26.820042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1900df-f2c4-41ce-9681-498677232fff service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:26.820790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1900df-f2c4-41ce-9681-498677232fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:26.822733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c1900df-f2c4-41ce-9681-498677232fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:26.942249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1900df-f2c4-41ce-9681-498677232fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:26.944584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1900df-f2c4-41ce-9681-498677232fff service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:26.972890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 660/1316] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:29.408350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a37728-b43b-422d-accc-651fb5aa2976 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.409326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a37728-b43b-422d-accc-651fb5aa2976 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.409326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a37728-b43b-422d-accc-651fb5aa2976 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.411341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 657/1317] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:29.417976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426efe5a-5fb2-4fe8-b86e-e2abd7b06558 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.418687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426efe5a-5fb2-4fe8-b86e-e2abd7b06558 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.418857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426efe5a-5fb2-4fe8-b86e-e2abd7b06558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.488422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-426efe5a-5fb2-4fe8-b86e-e2abd7b06558 None None] MFA Rules not processed for user `9d954de5ff0f4f03956c10acedd655bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:29.489684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-426efe5a-5fb2-4fe8-b86e-e2abd7b06558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:29.548304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:29.603958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 661/1318] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:29.891986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a37728-b43b-422d-accc-651fb5aa2976 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.894666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-17a37728-b43b-422d-accc-651fb5aa2976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:30.005272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a37728-b43b-422d-accc-651fb5aa2976 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.008125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.095756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f950289-ae74-4b09-b14d-26a647c93fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.096367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950289-ae74-4b09-b14d-26a647c93fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.096626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950289-ae74-4b09-b14d-26a647c93fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.096953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f950289-ae74-4b09-b14d-26a647c93fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.098564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4f950289-ae74-4b09-b14d-26a647c93fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:30.227304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f950289-ae74-4b09-b14d-26a647c93fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:30.228788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f950289-ae74-4b09-b14d-26a647c93fb5 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:30.248322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 658/1319] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:32.758247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634817c-f1ba-48a7-95d1-ae54388be3d6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.758739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634817c-f1ba-48a7-95d1-ae54388be3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.758739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634817c-f1ba-48a7-95d1-ae54388be3d6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.760120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 662/1320] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:32.766066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce6aa-5a16-425d-861c-53154d6bb520 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.766575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce6aa-5a16-425d-861c-53154d6bb520 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.766676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce6aa-5a16-425d-861c-53154d6bb520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.817998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:32.853319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b55ce6aa-5a16-425d-861c-53154d6bb520 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:32.854800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b55ce6aa-5a16-425d-861c-53154d6bb520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:32.984238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 659/1321] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:33.331740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634817c-f1ba-48a7-95d1-ae54388be3d6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:33.333317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c634817c-f1ba-48a7-95d1-ae54388be3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:33.467016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634817c-f1ba-48a7-95d1-ae54388be3d6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:33.544880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f663b-e43c-42eb-b157-fe68cc5c9494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:33.545510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f663b-e43c-42eb-b157-fe68cc5c9494 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:33.545755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f663b-e43c-42eb-b157-fe68cc5c9494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:33.546052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f663b-e43c-42eb-b157-fe68cc5c9494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:33.547670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-667f663b-e43c-42eb-b157-fe68cc5c9494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:33.556504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:33.675398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f663b-e43c-42eb-b157-fe68cc5c9494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:33.679110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f663b-e43c-42eb-b157-fe68cc5c9494 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:33.702727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 663/1322] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:36.339813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3366b26-fc9c-4db7-8c40-5f80cd499f6f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.340398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3366b26-fc9c-4db7-8c40-5f80cd499f6f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.340398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3366b26-fc9c-4db7-8c40-5f80cd499f6f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.341759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 660/1323] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:36.347344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24c20-1a31-41e5-a01a-2b7f65d4f4ab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.347809 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24c20-1a31-41e5-a01a-2b7f65d4f4ab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.347908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24c20-1a31-41e5-a01a-2b7f65d4f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.419763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6fb24c20-1a31-41e5-a01a-2b7f65d4f4ab None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:36.421274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6fb24c20-1a31-41e5-a01a-2b7f65d4f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:36.489069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:36.531170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 664/1324] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:36.817025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3366b26-fc9c-4db7-8c40-5f80cd499f6f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.818647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c3366b26-fc9c-4db7-8c40-5f80cd499f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:36.931287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3366b26-fc9c-4db7-8c40-5f80cd499f6f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.944253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:37.009848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e225c-1456-4796-84c0-e9e36af43738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.010409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e225c-1456-4796-84c0-e9e36af43738 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.010687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e225c-1456-4796-84c0-e9e36af43738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.010954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e225c-1456-4796-84c0-e9e36af43738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.012575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b53e225c-1456-4796-84c0-e9e36af43738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:37.126459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e225c-1456-4796-84c0-e9e36af43738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:37.127990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e225c-1456-4796-84c0-e9e36af43738 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:37.147290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 661/1325] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:39.121343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab7ee8-dd91-440d-88a2-d5e0c150ea84 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.121881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab7ee8-dd91-440d-88a2-d5e0c150ea84 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.121881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab7ee8-dd91-440d-88a2-d5e0c150ea84 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.123245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 665/1326] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:39.129017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b467-41a3-4b9e-b7e7-49e38710d974 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.129482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b467-41a3-4b9e-b7e7-49e38710d974 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.129585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b467-41a3-4b9e-b7e7-49e38710d974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.181793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:39.202389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f6a3b467-41a3-4b9e-b7e7-49e38710d974 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:39.203647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f6a3b467-41a3-4b9e-b7e7-49e38710d974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:39.308579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 662/1327] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:39.584818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab7ee8-dd91-440d-88a2-d5e0c150ea84 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:39.586386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-55ab7ee8-dd91-440d-88a2-d5e0c150ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:39.709583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab7ee8-dd91-440d-88a2-d5e0c150ea84 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:39.792588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6db6f2-4498-4f2c-b13c-1a91027077d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:39.793238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db6f2-4498-4f2c-b13c-1a91027077d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.793512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db6f2-4498-4f2c-b13c-1a91027077d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.793774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db6f2-4498-4f2c-b13c-1a91027077d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.795556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d6db6f2-4498-4f2c-b13c-1a91027077d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:39.814598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:39.914871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db6f2-4498-4f2c-b13c-1a91027077d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:39.916290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db6f2-4498-4f2c-b13c-1a91027077d9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:39.937072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 666/1328] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:41.924847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370201-f49b-4ae7-9366-6f2ef0fcf5bf None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.925494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370201-f49b-4ae7-9366-6f2ef0fcf5bf None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.925494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee370201-f49b-4ae7-9366-6f2ef0fcf5bf None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.926787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 663/1329] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:41.932129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0ef4-881b-491f-b5e6-4e757af1b3be None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.932606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0ef4-881b-491f-b5e6-4e757af1b3be None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.932702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0ef4-881b-491f-b5e6-4e757af1b3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.001798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6feb0ef4-881b-491f-b5e6-4e757af1b3be None None] MFA Rules not processed for user `9d954de5ff0f4f03956c10acedd655bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:42.003012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6feb0ef4-881b-491f-b5e6-4e757af1b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:42.073723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:42.108026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 667/1330] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:42.394817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee370201-f49b-4ae7-9366-6f2ef0fcf5bf None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:42.396365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ee370201-f49b-4ae7-9366-6f2ef0fcf5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:42.511806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee370201-f49b-4ae7-9366-6f2ef0fcf5bf None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:42.533906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:42.601114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecbc7d-b797-40e5-8fe0-6d80c1e40f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:42.601740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecbc7d-b797-40e5-8fe0-6d80c1e40f31 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:42.602019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecbc7d-b797-40e5-8fe0-6d80c1e40f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:42.602285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecbc7d-b797-40e5-8fe0-6d80c1e40f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.603933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-27ecbc7d-b797-40e5-8fe0-6d80c1e40f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:42.725118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecbc7d-b797-40e5-8fe0-6d80c1e40f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:42.726560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecbc7d-b797-40e5-8fe0-6d80c1e40f31 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:42.748121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 664/1331] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:45.047797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d437-a8eb-46f5-888c-6d6e0c1c67db None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.048371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d437-a8eb-46f5-888c-6d6e0c1c67db None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.048371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d437-a8eb-46f5-888c-6d6e0c1c67db None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.050551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 668/1332] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:45.059733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb471-d6d9-4476-94e7-466f30dc318e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.060185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb471-d6d9-4476-94e7-466f30dc318e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.060389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb471-d6d9-4476-94e7-466f30dc318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.133612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:45.136827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-63fcb471-d6d9-4476-94e7-466f30dc318e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:45.138609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-63fcb471-d6d9-4476-94e7-466f30dc318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:45.238924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 665/1333] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:45.532437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d437-a8eb-46f5-888c-6d6e0c1c67db None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:45.534013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3427d437-a8eb-46f5-888c-6d6e0c1c67db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:45.661032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d437-a8eb-46f5-888c-6d6e0c1c67db None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:45.738404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83b290-67b3-4373-959c-89e11cdb4b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:45.739302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b290-67b3-4373-959c-89e11cdb4b2a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.739574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b290-67b3-4373-959c-89e11cdb4b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.739844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b290-67b3-4373-959c-89e11cdb4b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.741472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bb83b290-67b3-4373-959c-89e11cdb4b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:45.771880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:45.878120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83b290-67b3-4373-959c-89e11cdb4b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:45.879630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83b290-67b3-4373-959c-89e11cdb4b2a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:45.899173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 669/1334] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:47.899166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2567b1-fb75-4fae-9b58-7f04fda78752 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:47.900064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2567b1-fb75-4fae-9b58-7f04fda78752 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:47.900163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2567b1-fb75-4fae-9b58-7f04fda78752 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:47.902391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 666/1335] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:47.908486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f857-9266-45af-81e4-3219a8d5ff30 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:47.908952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f857-9266-45af-81e4-3219a8d5ff30 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:47.909069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19f857-9266-45af-81e4-3219a8d5ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:47.983594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cb19f857-9266-45af-81e4-3219a8d5ff30 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:47.984898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cb19f857-9266-45af-81e4-3219a8d5ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:48.065944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:48.089030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 670/1336] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:48.374970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2567b1-fb75-4fae-9b58-7f04fda78752 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:48.377498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ca2567b1-fb75-4fae-9b58-7f04fda78752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:48.508169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2567b1-fb75-4fae-9b58-7f04fda78752 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:48.538435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:48.595087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d449ad-c683-49df-8980-b620229df35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:48.595684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d449ad-c683-49df-8980-b620229df35d service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:48.595958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d449ad-c683-49df-8980-b620229df35d service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:48.596228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d449ad-c683-49df-8980-b620229df35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:48.597865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-72d449ad-c683-49df-8980-b620229df35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:48.715725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d449ad-c683-49df-8980-b620229df35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:48.717290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d449ad-c683-49df-8980-b620229df35d service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:48.737944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 667/1337] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:51.009997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c556-9ec8-482c-93e0-5cd9a91d2cb1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.010562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c556-9ec8-482c-93e0-5cd9a91d2cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.010562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c556-9ec8-482c-93e0-5cd9a91d2cb1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.011789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 671/1338] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:51.018722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861c7a-68ab-4b99-b032-6e9ef044a3e5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.019435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861c7a-68ab-4b99-b032-6e9ef044a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.019598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861c7a-68ab-4b99-b032-6e9ef044a3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.105402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e7861c7a-68ab-4b99-b032-6e9ef044a3e5 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:51.106745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e7861c7a-68ab-4b99-b032-6e9ef044a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:51.116428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.210553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 668/1339] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:51.513012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0c556-9ec8-482c-93e0-5cd9a91d2cb1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.514574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f8c0c556-9ec8-482c-93e0-5cd9a91d2cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:51.631274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0c556-9ec8-482c-93e0-5cd9a91d2cb1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.737411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cbd1b-9671-458c-b317-c5de97f80005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.738021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbd1b-9671-458c-b317-c5de97f80005 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.738290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbd1b-9671-458c-b317-c5de97f80005 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.738518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbd1b-9671-458c-b317-c5de97f80005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.740154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-633cbd1b-9671-458c-b317-c5de97f80005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:51.777811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.856128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cbd1b-9671-458c-b317-c5de97f80005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.858035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cbd1b-9671-458c-b317-c5de97f80005 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.877853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 672/1340] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:55.803446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ad5c-68a2-46e5-8c41-c1b201bdd740 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:55.803984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ad5c-68a2-46e5-8c41-c1b201bdd740 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:55.804077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ad5c-68a2-46e5-8c41-c1b201bdd740 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:55.805469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 669/1341] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:55.811044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af3e0-ede2-4ee1-b767-bc58f333fec4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:55.811466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af3e0-ede2-4ee1-b767-bc58f333fec4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:55.811668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af3e0-ede2-4ee1-b767-bc58f333fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:55.881282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fb7af3e0-ede2-4ee1-b767-bc58f333fec4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:55.882528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb7af3e0-ede2-4ee1-b767-bc58f333fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:55.971364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:55.984345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 673/1342] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:56.264075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ad5c-68a2-46e5-8c41-c1b201bdd740 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:56.265668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ab72ad5c-68a2-46e5-8c41-c1b201bdd740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:56.375649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ad5c-68a2-46e5-8c41-c1b201bdd740 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:56.415167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:56.452413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5fda4-23b3-43d7-9509-26079e4f6eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:56.453049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5fda4-23b3-43d7-9509-26079e4f6eef service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.453324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5fda4-23b3-43d7-9509-26079e4f6eef service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.453592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5fda4-23b3-43d7-9509-26079e4f6eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.455170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a1d5fda4-23b3-43d7-9509-26079e4f6eef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:56.565396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5fda4-23b3-43d7-9509-26079e4f6eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:56.566752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5fda4-23b3-43d7-9509-26079e4f6eef service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:56.585060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 670/1343] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:54:59.145983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e40d13-254d-4993-93a3-a4a98507dd4a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.146547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e40d13-254d-4993-93a3-a4a98507dd4a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.146547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e40d13-254d-4993-93a3-a4a98507dd4a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.147905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 674/1344] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:59.153486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170238-3613-47bc-837f-88e0921dce87 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.154014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170238-3613-47bc-837f-88e0921dce87 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.154014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170238-3613-47bc-837f-88e0921dce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.225681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c4170238-3613-47bc-837f-88e0921dce87 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:59.226912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c4170238-3613-47bc-837f-88e0921dce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:59.245955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.328271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 671/1345] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:54:59.602595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e40d13-254d-4993-93a3-a4a98507dd4a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.604139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-34e40d13-254d-4993-93a3-a4a98507dd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:59.721802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e40d13-254d-4993-93a3-a4a98507dd4a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.819479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c40ecc-74cc-43f1-8f4f-ca7b16f33433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.820082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40ecc-74cc-43f1-8f4f-ca7b16f33433 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.820439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40ecc-74cc-43f1-8f4f-ca7b16f33433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.820730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40ecc-74cc-43f1-8f4f-ca7b16f33433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.822337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3c40ecc-74cc-43f1-8f4f-ca7b16f33433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:59.868882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.939097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c40ecc-74cc-43f1-8f4f-ca7b16f33433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.940552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c40ecc-74cc-43f1-8f4f-ca7b16f33433 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.961563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 675/1346] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:03.933470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6c93-41a1-46d4-91a4-ba9ceca87846 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.934453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6c93-41a1-46d4-91a4-ba9ceca87846 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.934729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6c93-41a1-46d4-91a4-ba9ceca87846 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.936117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 672/1347] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:03.941823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607286-fe05-4ecf-8c86-c5772b40ce8a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.942335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607286-fe05-4ecf-8c86-c5772b40ce8a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.942335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607286-fe05-4ecf-8c86-c5772b40ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.018420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-39607286-fe05-4ecf-8c86-c5772b40ce8a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:04.019676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39607286-fe05-4ecf-8c86-c5772b40ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:04.120373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.123587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 676/1348] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:04.407233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6c93-41a1-46d4-91a4-ba9ceca87846 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:04.408905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ab9a6c93-41a1-46d4-91a4-ba9ceca87846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:04.533284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6c93-41a1-46d4-91a4-ba9ceca87846 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.589721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.617738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e930334-fd87-444b-989f-72fccc754289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.618332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e930334-fd87-444b-989f-72fccc754289 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.618648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e930334-fd87-444b-989f-72fccc754289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.618978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e930334-fd87-444b-989f-72fccc754289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.620541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7e930334-fd87-444b-989f-72fccc754289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:04.734365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e930334-fd87-444b-989f-72fccc754289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:04.735854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e930334-fd87-444b-989f-72fccc754289 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:04.759016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 673/1349] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:09.686905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9379-1bf7-4b12-8d3e-94082759d67a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.687411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9379-1bf7-4b12-8d3e-94082759d67a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.687493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9379-1bf7-4b12-8d3e-94082759d67a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.689718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 677/1350] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 00:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:09.696329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efd76-ce84-4d47-b0ea-bb520d6414c6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.696778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efd76-ce84-4d47-b0ea-bb520d6414c6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.699182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efd76-ce84-4d47-b0ea-bb520d6414c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.839729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-db1efd76-ce84-4d47-b0ea-bb520d6414c6 None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:09.843713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-db1efd76-ce84-4d47-b0ea-bb520d6414c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:09.877941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:09.996190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 674/1351] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:14.037309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db412-bfca-47c7-bfae-8b8074091b3e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:14.037852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db412-bfca-47c7-bfae-8b8074091b3e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:14.037852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366db412-bfca-47c7-bfae-8b8074091b3e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:14.039398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 678/1352] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 00:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:14.045203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3226-617c-4786-9ac8-06c50c63224f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:14.045662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3226-617c-4786-9ac8-06c50c63224f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:14.045938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3226-617c-4786-9ac8-06c50c63224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:14.129858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-766f3226-617c-4786-9ac8-06c50c63224f None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:14.131178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-766f3226-617c-4786-9ac8-06c50c63224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:14.210490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:14.251092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 675/1353] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:15.643303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23aa26-8c63-4c94-9d27-5f9d5c764841 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:15.643885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23aa26-8c63-4c94-9d27-5f9d5c764841 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:15.643885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23aa26-8c63-4c94-9d27-5f9d5c764841 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:15.645203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 679/1354] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 00:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:15.650250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09126a83-b760-449d-b440-30092f3e3896 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:15.650690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09126a83-b760-449d-b440-30092f3e3896 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:15.650871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09126a83-b760-449d-b440-30092f3e3896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:15.736030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-09126a83-b760-449d-b440-30092f3e3896 None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:15.737597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-09126a83-b760-449d-b440-30092f3e3896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:15.849337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 676/1355] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 00:55:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:19.265321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bff89-2502-4aa5-bd3b-dbf7d2a03c15 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.265901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bff89-2502-4aa5-bd3b-dbf7d2a03c15 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.265901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bff89-2502-4aa5-bd3b-dbf7d2a03c15 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.267245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 680/1356] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:19.273013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f39796-2d6a-4314-ab79-bc1d592ebeae None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.273490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f39796-2d6a-4314-ab79-bc1d592ebeae None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.273586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f39796-2d6a-4314-ab79-bc1d592ebeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.316609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:19.355987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-49f39796-2d6a-4314-ab79-bc1d592ebeae None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:19.357232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-49f39796-2d6a-4314-ab79-bc1d592ebeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:19.498305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 677/1357] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:19.805484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e65b20-d347-4117-a01d-63e7a7ccff9f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.806066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e65b20-d347-4117-a01d-63e7a7ccff9f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.806571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e65b20-d347-4117-a01d-63e7a7ccff9f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.808415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 681/1358] 10.222.0.89 () {54 vars in 962 bytes} [Tue Aug 30 00:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:19.815898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1321d-d27c-4710-9732-4e5c8ed45f30 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.816183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1321d-d27c-4710-9732-4e5c8ed45f30 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.816598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1321d-d27c-4710-9732-4e5c8ed45f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.905435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0cd1321d-d27c-4710-9732-4e5c8ed45f30 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:19.906845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0cd1321d-d27c-4710-9732-4e5c8ed45f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:19.959857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:20.036621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 678/1359] 10.222.0.89 () {58 vars in 1059 bytes} [Tue Aug 30 00:55:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:55:20.044512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e65b20-d347-4117-a01d-63e7a7ccff9f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:20.046117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-04e65b20-d347-4117-a01d-63e7a7ccff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:20.197422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e65b20-d347-4117-a01d-63e7a7ccff9f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:20.278409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:20.321760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def617-0bf0-4b06-9676-3f8b0687fc51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:20.322396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def617-0bf0-4b06-9676-3f8b0687fc51 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:20.322793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def617-0bf0-4b06-9676-3f8b0687fc51 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:20.323525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def617-0bf0-4b06-9676-3f8b0687fc51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:20.325284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-81def617-0bf0-4b06-9676-3f8b0687fc51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:20.421005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81def617-0bf0-4b06-9676-3f8b0687fc51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:20.424530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81def617-0bf0-4b06-9676-3f8b0687fc51 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:20.446001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 682/1360] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:22.604107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c8e7-f868-4925-98c9-714eb2bd30e3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.604657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c8e7-f868-4925-98c9-714eb2bd30e3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.604910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c8e7-f868-4925-98c9-714eb2bd30e3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.607228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 679/1361] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:22.612968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360f90-b4d2-430a-a8fe-ebf6c20735ea None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.613497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360f90-b4d2-430a-a8fe-ebf6c20735ea None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.613497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360f90-b4d2-430a-a8fe-ebf6c20735ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.682640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e5360f90-b4d2-430a-a8fe-ebf6c20735ea None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:22.683745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e5360f90-b4d2-430a-a8fe-ebf6c20735ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:22.723311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:22.792408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 683/1362] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:23.077121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066c8e7-f868-4925-98c9-714eb2bd30e3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.079504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2066c8e7-f868-4925-98c9-714eb2bd30e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:23.253266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066c8e7-f868-4925-98c9-714eb2bd30e3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.263752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:23.385118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534a1ae-7759-4e05-ac0a-8976e85df594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.385738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534a1ae-7759-4e05-ac0a-8976e85df594 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.386017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534a1ae-7759-4e05-ac0a-8976e85df594 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.386288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534a1ae-7759-4e05-ac0a-8976e85df594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.387920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3534a1ae-7759-4e05-ac0a-8976e85df594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:23.495009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534a1ae-7759-4e05-ac0a-8976e85df594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:23.497340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534a1ae-7759-4e05-ac0a-8976e85df594 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:23.516927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 680/1363] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:25.746159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8695-f8ba-4fcb-adcf-eb91b0551c52 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.747057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8695-f8ba-4fcb-adcf-eb91b0551c52 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.747471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8695-f8ba-4fcb-adcf-eb91b0551c52 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.749968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 684/1364] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:25.756239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabd43-13dc-4b83-9fb9-9b642aeca2eb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.756673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabd43-13dc-4b83-9fb9-9b642aeca2eb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.756894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabd43-13dc-4b83-9fb9-9b642aeca2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.777243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.834988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2eeabd43-13dc-4b83-9fb9-9b642aeca2eb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:25.836446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2eeabd43-13dc-4b83-9fb9-9b642aeca2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:25.948859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 681/1365] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:26.253455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c23a9-3bab-4700-8921-bf269c72dcbf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.253720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c23a9-3bab-4700-8921-bf269c72dcbf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.254186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c23a9-3bab-4700-8921-bf269c72dcbf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.256955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 685/1366] 10.222.0.89 () {54 vars in 962 bytes} [Tue Aug 30 00:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:26.266859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4e823-b42f-4a9f-8b5c-fc491fa82536 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.267264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4e823-b42f-4a9f-8b5c-fc491fa82536 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.267682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4e823-b42f-4a9f-8b5c-fc491fa82536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.356313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-73b4e823-b42f-4a9f-8b5c-fc491fa82536 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:26.357452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-73b4e823-b42f-4a9f-8b5c-fc491fa82536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:26.397859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.493578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 682/1367] 10.222.0.89 () {58 vars in 1059 bytes} [Tue Aug 30 00:55:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:26.501611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c23a9-3bab-4700-8921-bf269c72dcbf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:26.503261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c9c23a9-3bab-4700-8921-bf269c72dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:26.665129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c23a9-3bab-4700-8921-bf269c72dcbf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.689213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.810497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81562-0a25-44ae-a686-8b3ec941ddbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.811194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81562-0a25-44ae-a686-8b3ec941ddbe service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.811456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81562-0a25-44ae-a686-8b3ec941ddbe service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.811745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81562-0a25-44ae-a686-8b3ec941ddbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.813839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-08d81562-0a25-44ae-a686-8b3ec941ddbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:26.913050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d81562-0a25-44ae-a686-8b3ec941ddbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.915183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d81562-0a25-44ae-a686-8b3ec941ddbe service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.938641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 686/1368] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:27.539166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c555b-65d9-4532-8cee-3fd50affffe0 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.539759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c555b-65d9-4532-8cee-3fd50affffe0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.539759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c555b-65d9-4532-8cee-3fd50affffe0 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.541340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 683/1369] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:27.546861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423a93-9cff-42e8-b974-caff070f4f21 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.547123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423a93-9cff-42e8-b974-caff070f4f21 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.547390 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423a93-9cff-42e8-b974-caff070f4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.585689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:27.620211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d8423a93-9cff-42e8-b974-caff070f4f21 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:27.621462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d8423a93-9cff-42e8-b974-caff070f4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:27.725094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 687/1370] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:28.348789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a080dfe-ddab-401f-b7d5-ba2898aed7b2 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.349176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a080dfe-ddab-401f-b7d5-ba2898aed7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.349512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a080dfe-ddab-401f-b7d5-ba2898aed7b2 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.351174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 684/1371] 10.222.0.89 () {54 vars in 964 bytes} [Tue Aug 30 00:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:28.356962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569554d-c1ed-49ac-b8a8-3822ea1e4aad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.357458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569554d-c1ed-49ac-b8a8-3822ea1e4aad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.357628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569554d-c1ed-49ac-b8a8-3822ea1e4aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.440211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a569554d-c1ed-49ac-b8a8-3822ea1e4aad None None] MFA Rules not processed for user `84fd8059995549a892fe769eb07dc322`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:28.441585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a569554d-c1ed-49ac-b8a8-3822ea1e4aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:28.495884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:28.529234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 688/1372] 10.222.0.89 () {58 vars in 1061 bytes} [Tue Aug 30 00:55:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:28.536944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a080dfe-ddab-401f-b7d5-ba2898aed7b2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:28.538530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1a080dfe-ddab-401f-b7d5-ba2898aed7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:28.648674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a080dfe-ddab-401f-b7d5-ba2898aed7b2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:28.696864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:28.742300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa82a35-4739-4154-a5ac-1643b66ce0bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:28.743379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82a35-4739-4154-a5ac-1643b66ce0bd service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.743739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82a35-4739-4154-a5ac-1643b66ce0bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.744776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa82a35-4739-4154-a5ac-1643b66ce0bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.746219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8fa82a35-4739-4154-a5ac-1643b66ce0bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:28.882359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa82a35-4739-4154-a5ac-1643b66ce0bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:28.883852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa82a35-4739-4154-a5ac-1643b66ce0bd service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:28.904364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 685/1373] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:55:28.939784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1298d-ad17-4d2a-b24f-27ce606ebc67 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.940106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1298d-ad17-4d2a-b24f-27ce606ebc67 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.940254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1298d-ad17-4d2a-b24f-27ce606ebc67 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.945368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 689/1374] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:28.946863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205779a2-1075-47a6-94ea-8cf25ad90d16 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.947378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205779a2-1075-47a6-94ea-8cf25ad90d16 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.947820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205779a2-1075-47a6-94ea-8cf25ad90d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.025647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-205779a2-1075-47a6-94ea-8cf25ad90d16 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:29.027624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-205779a2-1075-47a6-94ea-8cf25ad90d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:29.060484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.148860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 686/1375] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:29.436174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1298d-ad17-4d2a-b24f-27ce606ebc67 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.437744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3b1298d-ad17-4d2a-b24f-27ce606ebc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:29.594967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1298d-ad17-4d2a-b24f-27ce606ebc67 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.649932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.717926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67fe66-542e-4f83-9629-9a10ea90cb38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.718439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67fe66-542e-4f83-9629-9a10ea90cb38 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.718715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67fe66-542e-4f83-9629-9a10ea90cb38 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.718981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67fe66-542e-4f83-9629-9a10ea90cb38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.720584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5d67fe66-542e-4f83-9629-9a10ea90cb38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:29.820019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67fe66-542e-4f83-9629-9a10ea90cb38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:29.821651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67fe66-542e-4f83-9629-9a10ea90cb38 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:29.841226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 690/1376] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:31.786205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3570fc-64e9-4cda-952c-197fb8e4e7d6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.786720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3570fc-64e9-4cda-952c-197fb8e4e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.786720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3570fc-64e9-4cda-952c-197fb8e4e7d6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.788302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 687/1377] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:31.794196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2e11-8353-4868-ae1b-462282863a51 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.794636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2e11-8353-4868-ae1b-462282863a51 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.795050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2e11-8353-4868-ae1b-462282863a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.867146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d7eb2e11-8353-4868-ae1b-462282863a51 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:31.868598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7eb2e11-8353-4868-ae1b-462282863a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:31.876275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:31.995245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 691/1378] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:32.289753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3570fc-64e9-4cda-952c-197fb8e4e7d6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:32.291621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ee3570fc-64e9-4cda-952c-197fb8e4e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:32.493681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3570fc-64e9-4cda-952c-197fb8e4e7d6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:32.509263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:32.630169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067392d-4d85-4966-90a9-29baba946afe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:32.630736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067392d-4d85-4966-90a9-29baba946afe service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:32.631014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067392d-4d85-4966-90a9-29baba946afe service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:32.631292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067392d-4d85-4966-90a9-29baba946afe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:32.632962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9067392d-4d85-4966-90a9-29baba946afe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:32.738204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067392d-4d85-4966-90a9-29baba946afe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:32.739966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067392d-4d85-4966-90a9-29baba946afe service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:32.764334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 688/1379] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:34.794440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728b02-a313-4c1f-b713-7f151f9e2f80 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:34.795052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728b02-a313-4c1f-b713-7f151f9e2f80 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:34.795052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728b02-a313-4c1f-b713-7f151f9e2f80 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:34.796584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 692/1380] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:34.803832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00f515-2a7c-4816-a052-fe694defb950 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:34.804670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00f515-2a7c-4816-a052-fe694defb950 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:34.805178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00f515-2a7c-4816-a052-fe694defb950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:34.818760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:34.887105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0f00f515-2a7c-4816-a052-fe694defb950 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:34.888842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0f00f515-2a7c-4816-a052-fe694defb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:35.002521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 689/1381] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:35.286661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728b02-a313-4c1f-b713-7f151f9e2f80 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:35.288167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-31728b02-a313-4c1f-b713-7f151f9e2f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:35.438719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.450961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728b02-a313-4c1f-b713-7f151f9e2f80 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.580218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc25f2-da92-464a-8205-16b698a9cdc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.580862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc25f2-da92-464a-8205-16b698a9cdc1 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.581178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc25f2-da92-464a-8205-16b698a9cdc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.581483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc25f2-da92-464a-8205-16b698a9cdc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.583178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ffc25f2-da92-464a-8205-16b698a9cdc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:35.693003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc25f2-da92-464a-8205-16b698a9cdc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:35.694642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc25f2-da92-464a-8205-16b698a9cdc1 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:35.705960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.716696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 693/1382] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:37.866522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e11d-5eef-4189-a668-a22bd7b846fd None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.867233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e11d-5eef-4189-a668-a22bd7b846fd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.867233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e11d-5eef-4189-a668-a22bd7b846fd None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.868556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 690/1383] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:37.874953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cca9-917f-4749-956d-2293cf2985ee None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.875590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cca9-917f-4749-956d-2293cf2985ee None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.875590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cca9-917f-4749-956d-2293cf2985ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.950751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-11e3cca9-917f-4749-956d-2293cf2985ee None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:37.952063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11e3cca9-917f-4749-956d-2293cf2985ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:38.064155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 694/1384] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:38.373987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e11d-5eef-4189-a668-a22bd7b846fd None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:38.375588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b298e11d-5eef-4189-a668-a22bd7b846fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:38.493321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:38.560776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e11d-5eef-4189-a668-a22bd7b846fd None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:38.705735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96fc71-fc62-40a5-a5b4-d7f632bcf468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:38.706476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96fc71-fc62-40a5-a5b4-d7f632bcf468 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:38.706843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96fc71-fc62-40a5-a5b4-d7f632bcf468 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:38.707160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96fc71-fc62-40a5-a5b4-d7f632bcf468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:38.709298 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cb96fc71-fc62-40a5-a5b4-d7f632bcf468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:38.787305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:38.834980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96fc71-fc62-40a5-a5b4-d7f632bcf468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:38.837706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96fc71-fc62-40a5-a5b4-d7f632bcf468 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:38.859800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 691/1385] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:40.770262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3fd6a-1b9d-4296-bf10-1048bb5c7d50 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.770907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3fd6a-1b9d-4296-bf10-1048bb5c7d50 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.770907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3fd6a-1b9d-4296-bf10-1048bb5c7d50 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.772185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 695/1386] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:40.778889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1b125-959f-4d57-903d-b9f1213bdce1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.779428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1b125-959f-4d57-903d-b9f1213bdce1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.779537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1b125-959f-4d57-903d-b9f1213bdce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.868864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b8d1b125-959f-4d57-903d-b9f1213bdce1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:40.870334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b8d1b125-959f-4d57-903d-b9f1213bdce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:40.979087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 692/1387] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:41.286377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3fd6a-1b9d-4296-bf10-1048bb5c7d50 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:41.287945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-acb3fd6a-1b9d-4296-bf10-1048bb5c7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:41.370622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:41.450846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3fd6a-1b9d-4296-bf10-1048bb5c7d50 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:41.617687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7db01-de7f-49cf-95bd-a9824c466ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:41.618306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7db01-de7f-49cf-95bd-a9824c466ff0 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.618713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7db01-de7f-49cf-95bd-a9824c466ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.619078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7db01-de7f-49cf-95bd-a9824c466ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.620820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffd7db01-de7f-49cf-95bd-a9824c466ff0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:41.660910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:41.714054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7db01-de7f-49cf-95bd-a9824c466ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:41.715667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7db01-de7f-49cf-95bd-a9824c466ff0 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:41.734765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 696/1388] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:43.677884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf146f-b7f9-49ee-8217-6c565baf587e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.678615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf146f-b7f9-49ee-8217-6c565baf587e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.678615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf146f-b7f9-49ee-8217-6c565baf587e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.679798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 693/1389] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:43.685668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd920-79c1-438b-80d5-4dec91fdcd40 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.686173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd920-79c1-438b-80d5-4dec91fdcd40 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.686173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd920-79c1-438b-80d5-4dec91fdcd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.761645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c1bfd920-79c1-438b-80d5-4dec91fdcd40 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:43.762866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c1bfd920-79c1-438b-80d5-4dec91fdcd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:43.864058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 697/1390] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:44.150850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf146f-b7f9-49ee-8217-6c565baf587e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:44.152381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ccdf146f-b7f9-49ee-8217-6c565baf587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:44.184484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:44.315668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf146f-b7f9-49ee-8217-6c565baf587e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:44.366326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6f5e-a98c-47da-89a1-00a119adbabd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:44.366611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6f5e-a98c-47da-89a1-00a119adbabd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:44.366914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be6f5e-a98c-47da-89a1-00a119adbabd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:44.368679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 698/1391] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:44.374095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c804a7-adc7-4934-af5f-5ee023691fce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:44.374421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c804a7-adc7-4934-af5f-5ee023691fce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:44.374691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c804a7-adc7-4934-af5f-5ee023691fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:44.391504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:44.428349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:44.441733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae59c7f-2e31-4fca-a8a2-d8f44e91f416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:44.442585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae59c7f-2e31-4fca-a8a2-d8f44e91f416 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:44.442859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae59c7f-2e31-4fca-a8a2-d8f44e91f416 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:44.443134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae59c7f-2e31-4fca-a8a2-d8f44e91f416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:44.445240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aae59c7f-2e31-4fca-a8a2-d8f44e91f416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:44.447420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-45c804a7-adc7-4934-af5f-5ee023691fce None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:44.449138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-45c804a7-adc7-4934-af5f-5ee023691fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:44.537961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae59c7f-2e31-4fca-a8a2-d8f44e91f416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:44.539568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae59c7f-2e31-4fca-a8a2-d8f44e91f416 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:44.551581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 699/1392] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:44.558791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 694/1393] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:44.849918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ae7c2-92b4-41fd-8b9e-cc41b2e594e1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:44.850414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ae7c2-92b4-41fd-8b9e-cc41b2e594e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:44.850414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ae7c2-92b4-41fd-8b9e-cc41b2e594e1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:44.851823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 700/1394] 10.222.0.89 () {54 vars in 967 bytes} [Tue Aug 30 00:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:44.857504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683793-8777-48a3-b575-ef4fa409b44b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:44.857970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683793-8777-48a3-b575-ef4fa409b44b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:44.858089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683793-8777-48a3-b575-ef4fa409b44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:44.939651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c7683793-8777-48a3-b575-ef4fa409b44b None None] MFA Rules not processed for user `1c0449abfbe044b3aff4f24a5f1b7b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:44.940920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c7683793-8777-48a3-b575-ef4fa409b44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:44.996395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:45.021540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 695/1395] 10.222.0.89 () {58 vars in 1064 bytes} [Tue Aug 30 00:55:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:45.030244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ae7c2-92b4-41fd-8b9e-cc41b2e594e1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:45.031839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f79ae7c2-92b4-41fd-8b9e-cc41b2e594e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:45.138473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:45.146848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ae7c2-92b4-41fd-8b9e-cc41b2e594e1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:45.223935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580217f4-b09f-460d-a864-1f639bbc172a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:45.224542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580217f4-b09f-460d-a864-1f639bbc172a service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:45.224839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580217f4-b09f-460d-a864-1f639bbc172a service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:45.225105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580217f4-b09f-460d-a864-1f639bbc172a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:45.226695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-580217f4-b09f-460d-a864-1f639bbc172a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:45.341563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580217f4-b09f-460d-a864-1f639bbc172a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:45.342977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580217f4-b09f-460d-a864-1f639bbc172a service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:45.361752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 701/1396] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:46.151718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6fb53-236f-41e7-aef3-b466a634f890 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.152305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6fb53-236f-41e7-aef3-b466a634f890 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.152411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6fb53-236f-41e7-aef3-b466a634f890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.222685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-73e6fb53-236f-41e7-aef3-b466a634f890 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:46.223940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-73e6fb53-236f-41e7-aef3-b466a634f890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:46.317918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 696/1397] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:46.366419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac7f2-605b-413f-a898-5583b18d5ebe None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.366904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac7f2-605b-413f-a898-5583b18d5ebe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.367019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac7f2-605b-413f-a898-5583b18d5ebe None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.368482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 702/1398] 10.222.0.89 () {54 vars in 943 bytes} [Tue Aug 30 00:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:46.375270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9e53-86fe-44e3-a3ab-68da8ac1d79c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.375561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9e53-86fe-44e3-a3ab-68da8ac1d79c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.375830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9e53-86fe-44e3-a3ab-68da8ac1d79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.456912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-724c9e53-86fe-44e3-a3ab-68da8ac1d79c None None] MFA Rules not processed for user `c589ae1e5d3843cd92fe1a125990771d`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:46.458150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-724c9e53-86fe-44e3-a3ab-68da8ac1d79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:46.472004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.519582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814705ee-31b1-4702-91c5-219ce4bf6a3c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.519869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814705ee-31b1-4702-91c5-219ce4bf6a3c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.520135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814705ee-31b1-4702-91c5-219ce4bf6a3c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.521515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 703/1399] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:46.526369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.526649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.526941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.553775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.571430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 697/1400] 10.222.0.89 () {58 vars in 1040 bytes} [Tue Aug 30 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:46.582785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9e53-86fe-44e3-a3ab-68da8ac1d79c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.592558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9e53-86fe-44e3-a3ab-68da8ac1d79c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.594697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:46.595898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:46.694928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 704/1401] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:55:46.702421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a59353-4629-459a-81c2-e12fb8cf6575 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.703029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59353-4629-459a-81c2-e12fb8cf6575 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.703297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59353-4629-459a-81c2-e12fb8cf6575 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.703570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59353-4629-459a-81c2-e12fb8cf6575 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.705254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-16a59353-4629-459a-81c2-e12fb8cf6575 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:46.723787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.791104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a59353-4629-459a-81c2-e12fb8cf6575 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.792681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a59353-4629-459a-81c2-e12fb8cf6575 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.801319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 698/1402] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 00:55:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:55:47.020325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.021654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:47.133796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.149892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f046e28-8bd9-42b9-b6f9-a4028b85dc14 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.291483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ba22-640a-4af2-89a2-74daa8d6321e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.292312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ba22-640a-4af2-89a2-74daa8d6321e service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.292707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ba22-640a-4af2-89a2-74daa8d6321e service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.293071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ba22-640a-4af2-89a2-74daa8d6321e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.294856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9312ba22-640a-4af2-89a2-74daa8d6321e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:47.398605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ba22-640a-4af2-89a2-74daa8d6321e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.400244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ba22-640a-4af2-89a2-74daa8d6321e service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.414726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.424074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 705/1403] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:49.441168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1092f-240c-4a3a-907e-3eeea1a49a71 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:49.441801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1092f-240c-4a3a-907e-3eeea1a49a71 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:49.441801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1092f-240c-4a3a-907e-3eeea1a49a71 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:49.443085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 699/1404] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:49.448825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37820a5-c614-4503-acab-ed79cfa7e80c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:49.449300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37820a5-c614-4503-acab-ed79cfa7e80c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:49.449300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37820a5-c614-4503-acab-ed79cfa7e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:49.522002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f37820a5-c614-4503-acab-ed79cfa7e80c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:49.523330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f37820a5-c614-4503-acab-ed79cfa7e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:49.644852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 706/1405] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:49.937224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1092f-240c-4a3a-907e-3eeea1a49a71 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:49.938829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b6d1092f-240c-4a3a-907e-3eeea1a49a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:50.110458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1092f-240c-4a3a-907e-3eeea1a49a71 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:50.123006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:50.232685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da9cf-c30a-4d92-a36f-591ccf3c3a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:50.233331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da9cf-c30a-4d92-a36f-591ccf3c3a1e service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.233605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da9cf-c30a-4d92-a36f-591ccf3c3a1e service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.233878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da9cf-c30a-4d92-a36f-591ccf3c3a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.235491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-946da9cf-c30a-4d92-a36f-591ccf3c3a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:50.348552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946da9cf-c30a-4d92-a36f-591ccf3c3a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:50.350205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946da9cf-c30a-4d92-a36f-591ccf3c3a1e service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:50.368846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 700/1406] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:55:52.342938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97977b88-fc78-40d0-8e1d-234024935090 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:52.343553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97977b88-fc78-40d0-8e1d-234024935090 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:52.343945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97977b88-fc78-40d0-8e1d-234024935090 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:52.349185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 707/1407] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:55:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:52.353312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3dfa-45bc-455e-aedc-8f4f0d0cd43d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:52.353312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3dfa-45bc-455e-aedc-8f4f0d0cd43d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:52.353312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3dfa-45bc-455e-aedc-8f4f0d0cd43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:52.374082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:52.432054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-422a3dfa-45bc-455e-aedc-8f4f0d0cd43d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:52.433440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-422a3dfa-45bc-455e-aedc-8f4f0d0cd43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:52.539664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 701/1408] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:55:52.828827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97977b88-fc78-40d0-8e1d-234024935090 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:52.830367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-97977b88-fc78-40d0-8e1d-234024935090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:52.913429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:52.994066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97977b88-fc78-40d0-8e1d-234024935090 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:53.163540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b8e84-e85b-437b-8f48-0664b18997a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:53.164158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b8e84-e85b-437b-8f48-0664b18997a5 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.164483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b8e84-e85b-437b-8f48-0664b18997a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.164749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b8e84-e85b-437b-8f48-0664b18997a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.166475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-eb7b8e84-e85b-437b-8f48-0664b18997a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:53.208726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:53.266221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b8e84-e85b-437b-8f48-0664b18997a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:53.267923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b8e84-e85b-437b-8f48-0664b18997a5 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:53.286606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 708/1409] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:02.537839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=58 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:03.284441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=29 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:09.253750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb160-dca0-4c2f-9b62-59a4de01a7fe None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:09.254306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb160-dca0-4c2f-9b62-59a4de01a7fe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:09.254306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fb160-dca0-4c2f-9b62-59a4de01a7fe None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:09.255783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 702/1410] 10.222.0.89 () {54 vars in 918 bytes} [Tue Aug 30 00:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:09.261916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798be6-1373-408d-b35e-8875f5afc2a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:09.262394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798be6-1373-408d-b35e-8875f5afc2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:09.262514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798be6-1373-408d-b35e-8875f5afc2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:09.356713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e7798be6-1373-408d-b35e-8875f5afc2a2 None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:09.358008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e7798be6-1373-408d-b35e-8875f5afc2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:09.471253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 709/1411] 10.222.0.89 () {58 vars in 1015 bytes} [Tue Aug 30 00:56:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:09.489050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e558a-9480-404e-b03a-54eee6aae7ed None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:09.489325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e558a-9480-404e-b03a-54eee6aae7ed None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:09.489594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e558a-9480-404e-b03a-54eee6aae7ed None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:09.490959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 703/1412] 10.222.0.89 () {54 vars in 918 bytes} [Tue Aug 30 00:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:09.496315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0109-05fe-41b6-906b-725968f98663 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:09.496602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0109-05fe-41b6-906b-725968f98663 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:09.496908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0109-05fe-41b6-906b-725968f98663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:09.578870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:09.581979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fc5f0109-05fe-41b6-906b-725968f98663 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:09.583730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc5f0109-05fe-41b6-906b-725968f98663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:09.720971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 710/1413] 10.222.0.89 () {58 vars in 1015 bytes} [Tue Aug 30 00:56:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:12.108294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356009bb-6148-4323-85f5-0217ac6c08a4 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:12.108862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356009bb-6148-4323-85f5-0217ac6c08a4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:12.108862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356009bb-6148-4323-85f5-0217ac6c08a4 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:12.110146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:12.116628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5323470-49ae-4066-8b8f-be6079b814b4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:12.117108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5323470-49ae-4066-8b8f-be6079b814b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:12.117215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5323470-49ae-4066-8b8f-be6079b814b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:12.192011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d5323470-49ae-4066-8b8f-be6079b814b4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:12.193271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d5323470-49ae-4066-8b8f-be6079b814b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:12.251904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:12.294618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:12.590246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356009bb-6148-4323-85f5-0217ac6c08a4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:12.591781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-356009bb-6148-4323-85f5-0217ac6c08a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:12.744997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356009bb-6148-4323-85f5-0217ac6c08a4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:12.824245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:12.867891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a87cb-aef6-4089-8ad5-1248488aa684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:12.868523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a87cb-aef6-4089-8ad5-1248488aa684 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:12.868830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a87cb-aef6-4089-8ad5-1248488aa684 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:12.869095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a87cb-aef6-4089-8ad5-1248488aa684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:12.870693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-df9a87cb-aef6-4089-8ad5-1248488aa684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:12.966502 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a87cb-aef6-4089-8ad5-1248488aa684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:12.968091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a87cb-aef6-4089-8ad5-1248488aa684 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:12.989029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 705/1416] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:13.878288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f85fe8-e3b2-4b95-9d43-1c313328c5a7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:13.879168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f85fe8-e3b2-4b95-9d43-1c313328c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:13.879168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f85fe8-e3b2-4b95-9d43-1c313328c5a7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:13.881408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:13.889116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e97c-fcb0-4fa7-b4ef-76ac2591aeec None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:13.889575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e97c-fcb0-4fa7-b4ef-76ac2591aeec None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:13.889681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e97c-fcb0-4fa7-b4ef-76ac2591aeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:13.987964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bde1e97c-fcb0-4fa7-b4ef-76ac2591aeec None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:13.989346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bde1e97c-fcb0-4fa7-b4ef-76ac2591aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:14.019102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:14.089531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:14.246338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f85fe8-e3b2-4b95-9d43-1c313328c5a7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:14.248435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-79f85fe8-e3b2-4b95-9d43-1c313328c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:14.419135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f85fe8-e3b2-4b95-9d43-1c313328c5a7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:14.465944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:14.543382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387a679-f840-4923-ba6e-6c592a9f1ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:14.543986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a679-f840-4923-ba6e-6c592a9f1ef3 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:14.544258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a679-f840-4923-ba6e-6c592a9f1ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:14.544521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a679-f840-4923-ba6e-6c592a9f1ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:14.546177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a387a679-f840-4923-ba6e-6c592a9f1ef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:14.660127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a679-f840-4923-ba6e-6c592a9f1ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:14.661810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a679-f840-4923-ba6e-6c592a9f1ef3 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:14.684204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 713/1419] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:15.599015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62d458-b02e-4e77-9c19-d6d99e2c9208 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:15.599954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62d458-b02e-4e77-9c19-d6d99e2c9208 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:15.599954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62d458-b02e-4e77-9c19-d6d99e2c9208 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:15.602001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:15.608594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011709d-505b-4f67-a201-4744df17ec0e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:15.609284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011709d-505b-4f67-a201-4744df17ec0e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:15.609478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011709d-505b-4f67-a201-4744df17ec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:15.673509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:15.697043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0011709d-505b-4f67-a201-4744df17ec0e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:15.698383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0011709d-505b-4f67-a201-4744df17ec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:15.799332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:15.960676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62d458-b02e-4e77-9c19-d6d99e2c9208 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:15.963418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0b62d458-b02e-4e77-9c19-d6d99e2c9208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:16.132989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62d458-b02e-4e77-9c19-d6d99e2c9208 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:16.145554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:16.255122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948abb-74df-488e-be78-c95bab444f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:16.255748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948abb-74df-488e-be78-c95bab444f55 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:16.256024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948abb-74df-488e-be78-c95bab444f55 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:16.256293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948abb-74df-488e-be78-c95bab444f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:16.257959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ee948abb-74df-488e-be78-c95bab444f55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:16.353247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948abb-74df-488e-be78-c95bab444f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:16.354884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948abb-74df-488e-be78-c95bab444f55 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:16.374651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 708/1422] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:17.241998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e282e-1100-4226-bcf1-d9c668e68550 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:17.242666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e282e-1100-4226-bcf1-d9c668e68550 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:17.242666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e282e-1100-4226-bcf1-d9c668e68550 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:17.244498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:17.251255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94a23-4356-4dc5-a12e-3edadd0c40d5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:17.251742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94a23-4356-4dc5-a12e-3edadd0c40d5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:17.251892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94a23-4356-4dc5-a12e-3edadd0c40d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:17.281297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:17.340024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fcd94a23-4356-4dc5-a12e-3edadd0c40d5 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:17.341268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fcd94a23-4356-4dc5-a12e-3edadd0c40d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:17.444821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:17.599477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e282e-1100-4226-bcf1-d9c668e68550 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:17.602066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-749e282e-1100-4226-bcf1-d9c668e68550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:17.719156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:17.759459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e282e-1100-4226-bcf1-d9c668e68550 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:17.890380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f0911-6eaa-4d30-9a1d-ed6d57bd337c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:17.890897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0911-6eaa-4d30-9a1d-ed6d57bd337c service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:17.891173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0911-6eaa-4d30-9a1d-ed6d57bd337c service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:17.891428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f0911-6eaa-4d30-9a1d-ed6d57bd337c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:17.893059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-590f0911-6eaa-4d30-9a1d-ed6d57bd337c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:17.975127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:17.989579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f0911-6eaa-4d30-9a1d-ed6d57bd337c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:17.991195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f0911-6eaa-4d30-9a1d-ed6d57bd337c service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:18.010254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 716/1425] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:18.874231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f573b-5a11-484b-b5ed-7209f90b3ad7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:18.875153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f573b-5a11-484b-b5ed-7209f90b3ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:18.875153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f573b-5a11-484b-b5ed-7209f90b3ad7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:18.876519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:18.882629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfcb72-72b2-4282-ae4e-b42afb62f75c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:18.883391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfcb72-72b2-4282-ae4e-b42afb62f75c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:18.883573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfcb72-72b2-4282-ae4e-b42afb62f75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:18.975261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f8bfcb72-72b2-4282-ae4e-b42afb62f75c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:18.976502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f8bfcb72-72b2-4282-ae4e-b42afb62f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:19.081965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:19.250682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f573b-5a11-484b-b5ed-7209f90b3ad7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:19.253623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-373f573b-5a11-484b-b5ed-7209f90b3ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:19.359611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:19.427661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f573b-5a11-484b-b5ed-7209f90b3ad7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:19.678352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d761ba-8ae1-40cd-9b36-d746f7c4d8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:19.678864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d761ba-8ae1-40cd-9b36-d746f7c4d8d9 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:19.679135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d761ba-8ae1-40cd-9b36-d746f7c4d8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:19.679398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d761ba-8ae1-40cd-9b36-d746f7c4d8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:19.681053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-62d761ba-8ae1-40cd-9b36-d746f7c4d8d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:19.733720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:19.778532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d761ba-8ae1-40cd-9b36-d746f7c4d8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:19.780374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d761ba-8ae1-40cd-9b36-d746f7c4d8d9 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:19.800327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 711/1428] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:20.595410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81244-2662-4aed-8398-30c8b0de04d6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:20.596005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81244-2662-4aed-8398-30c8b0de04d6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:20.596005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c81244-2662-4aed-8398-30c8b0de04d6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:20.597328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:20.603763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1fef-405d-497f-9a8d-50f166ea7e35 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:20.604220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1fef-405d-497f-9a8d-50f166ea7e35 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:20.604453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1fef-405d-497f-9a8d-50f166ea7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:20.701979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-173f1fef-405d-497f-9a8d-50f166ea7e35 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:20.703206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-173f1fef-405d-497f-9a8d-50f166ea7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:20.813977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:20.966489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c81244-2662-4aed-8398-30c8b0de04d6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:20.968740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68c81244-2662-4aed-8398-30c8b0de04d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:21.028013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:21.141062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c81244-2662-4aed-8398-30c8b0de04d6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:21.263475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e270bfb-97ad-4a3e-85f8-aadba351f305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:21.264078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270bfb-97ad-4a3e-85f8-aadba351f305 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:21.264330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270bfb-97ad-4a3e-85f8-aadba351f305 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:21.264593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270bfb-97ad-4a3e-85f8-aadba351f305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:21.266239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8e270bfb-97ad-4a3e-85f8-aadba351f305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:21.273387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:21.360274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e270bfb-97ad-4a3e-85f8-aadba351f305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:21.361899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e270bfb-97ad-4a3e-85f8-aadba351f305 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:21.381455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 719/1431] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:22.225769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f746e-20dd-4386-8712-92c79cb4aea7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:22.226606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f746e-20dd-4386-8712-92c79cb4aea7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:22.226606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f746e-20dd-4386-8712-92c79cb4aea7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:22.228695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:22.235125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e4c2d-c447-4415-9064-45a5d9ce10e7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:22.235703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e4c2d-c447-4415-9064-45a5d9ce10e7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:22.235703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e4c2d-c447-4415-9064-45a5d9ce10e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:22.328612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6c4e4c2d-c447-4415-9064-45a5d9ce10e7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:22.329896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c4e4c2d-c447-4415-9064-45a5d9ce10e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:22.406114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:22.437445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:22.596216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f746e-20dd-4386-8712-92c79cb4aea7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:22.597758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2e1f746e-20dd-4386-8712-92c79cb4aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:22.618231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:22.771076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f746e-20dd-4386-8712-92c79cb4aea7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:22.890890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:22.918536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589ce19-abef-4a09-a69f-6c2be146a1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:22.919137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589ce19-abef-4a09-a69f-6c2be146a1ff service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:22.919403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589ce19-abef-4a09-a69f-6c2be146a1ff service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:22.919660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589ce19-abef-4a09-a69f-6c2be146a1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:22.921275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f589ce19-abef-4a09-a69f-6c2be146a1ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:23.025290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589ce19-abef-4a09-a69f-6c2be146a1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:23.026955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589ce19-abef-4a09-a69f-6c2be146a1ff service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:23.048169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 714/1434] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:23.868845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0d322-2ca4-48d6-bd86-3acaefa64221 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:23.869673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0d322-2ca4-48d6-bd86-3acaefa64221 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:23.869760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0d322-2ca4-48d6-bd86-3acaefa64221 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:23.871159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:23.876431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62bbbe-8eda-4541-b543-1c0ab5a4004d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:23.876916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62bbbe-8eda-4541-b543-1c0ab5a4004d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:23.877028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62bbbe-8eda-4541-b543-1c0ab5a4004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:23.959300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5b62bbbe-8eda-4541-b543-1c0ab5a4004d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:23.960556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5b62bbbe-8eda-4541-b543-1c0ab5a4004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:24.010843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:24.067547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:24.225259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0d322-2ca4-48d6-bd86-3acaefa64221 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:24.226881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3fe0d322-2ca4-48d6-bd86-3acaefa64221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:24.402110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0d322-2ca4-48d6-bd86-3acaefa64221 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:24.459575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:24.534874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c1d2-89d2-4197-a2aa-4833f3e849eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:24.535715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c1d2-89d2-4197-a2aa-4833f3e849eb service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:24.536120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c1d2-89d2-4197-a2aa-4833f3e849eb service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:24.536401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c1d2-89d2-4197-a2aa-4833f3e849eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:24.538465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-18c5c1d2-89d2-4197-a2aa-4833f3e849eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:24.644243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5c1d2-89d2-4197-a2aa-4833f3e849eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:24.645942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5c1d2-89d2-4197-a2aa-4833f3e849eb service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:24.665269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 722/1437] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:25.504709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cdac5-afad-4e54-b941-7fe35cbe083d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:25.505300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cdac5-afad-4e54-b941-7fe35cbe083d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:25.505300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cdac5-afad-4e54-b941-7fe35cbe083d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:25.507406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:25.515233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d679-500e-4a54-928b-7d66ce303b30 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:25.515723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d679-500e-4a54-928b-7d66ce303b30 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:25.515830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d679-500e-4a54-928b-7d66ce303b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:25.599591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4473d679-500e-4a54-928b-7d66ce303b30 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:25.600839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4473d679-500e-4a54-928b-7d66ce303b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:25.602977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:25.704666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:25.859366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cdac5-afad-4e54-b941-7fe35cbe083d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:25.861882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a01cdac5-afad-4e54-b941-7fe35cbe083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:26.047539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cdac5-afad-4e54-b941-7fe35cbe083d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:26.076603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:26.170833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bdce9-21b1-4157-aa60-290b2fe26316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:26.171463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdce9-21b1-4157-aa60-290b2fe26316 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:26.171735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdce9-21b1-4157-aa60-290b2fe26316 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:26.172010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdce9-21b1-4157-aa60-290b2fe26316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:26.173657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-569bdce9-21b1-4157-aa60-290b2fe26316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:26.269925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bdce9-21b1-4157-aa60-290b2fe26316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:26.271870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bdce9-21b1-4157-aa60-290b2fe26316 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:26.294317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 717/1440] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:28.126694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de43a-7d7c-4b7e-8aad-f705040cf826 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:28.127481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de43a-7d7c-4b7e-8aad-f705040cf826 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:28.127481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de43a-7d7c-4b7e-8aad-f705040cf826 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:28.129683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:28.136060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf8e4-b517-485f-803e-c39aadecc37e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:28.136849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf8e4-b517-485f-803e-c39aadecc37e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:28.137014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaf8e4-b517-485f-803e-c39aadecc37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:28.180378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:28.208009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3abaf8e4-b517-485f-803e-c39aadecc37e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:28.209274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3abaf8e4-b517-485f-803e-c39aadecc37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:28.321833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:28.611890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081de43a-7d7c-4b7e-8aad-f705040cf826 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:28.613496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-081de43a-7d7c-4b7e-8aad-f705040cf826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:28.732144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081de43a-7d7c-4b7e-8aad-f705040cf826 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:28.772128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:28.825672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a0d0f-bdf9-4792-b54b-7fef89eda497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:28.826306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a0d0f-bdf9-4792-b54b-7fef89eda497 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:28.826583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a0d0f-bdf9-4792-b54b-7fef89eda497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:28.826847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a0d0f-bdf9-4792-b54b-7fef89eda497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:28.828471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-431a0d0f-bdf9-4792-b54b-7fef89eda497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:28.948563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a0d0f-bdf9-4792-b54b-7fef89eda497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:28.950092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a0d0f-bdf9-4792-b54b-7fef89eda497 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:28.969629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 725/1443] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:31.107288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a09eb-f36e-47bc-b9c3-dfa2713954d4 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:31.107831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a09eb-f36e-47bc-b9c3-dfa2713954d4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:31.107831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a09eb-f36e-47bc-b9c3-dfa2713954d4 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:31.109150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:31.115492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98951526-e266-4394-b9dc-4a434e44b0d0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:31.115949 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98951526-e266-4394-b9dc-4a434e44b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:31.116060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98951526-e266-4394-b9dc-4a434e44b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:31.207203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-98951526-e266-4394-b9dc-4a434e44b0d0 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:31.208418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98951526-e266-4394-b9dc-4a434e44b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:31.222650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:31.328559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:31.620048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a09eb-f36e-47bc-b9c3-dfa2713954d4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:31.622679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a69a09eb-f36e-47bc-b9c3-dfa2713954d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:31.754653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a09eb-f36e-47bc-b9c3-dfa2713954d4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:31.771601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:31.844788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aad22-77a7-4674-b8ce-497169181f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:31.845430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aad22-77a7-4674-b8ce-497169181f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:31.845707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aad22-77a7-4674-b8ce-497169181f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:31.845960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aad22-77a7-4674-b8ce-497169181f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:31.847612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-913aad22-77a7-4674-b8ce-497169181f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:31.980507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aad22-77a7-4674-b8ce-497169181f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:31.983189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aad22-77a7-4674-b8ce-497169181f56 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:32.007030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 720/1446] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:34.532243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736760-94df-4770-ae7a-cc700d78e9c0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:34.533165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736760-94df-4770-ae7a-cc700d78e9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:34.533165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736760-94df-4770-ae7a-cc700d78e9c0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:34.535370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:34.541883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc26860-9392-4ce2-9380-e060783a92b2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:34.542579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc26860-9392-4ce2-9380-e060783a92b2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:34.542749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc26860-9392-4ce2-9380-e060783a92b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:34.600146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:34.620291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6bc26860-9392-4ce2-9380-e060783a92b2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:34.621529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6bc26860-9392-4ce2-9380-e060783a92b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:34.734519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:35.035979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736760-94df-4770-ae7a-cc700d78e9c0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:35.037602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-38736760-94df-4770-ae7a-cc700d78e9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:35.153118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736760-94df-4770-ae7a-cc700d78e9c0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:35.196181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:35.232170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36888b-6ed3-4ba3-8bac-70053c26e335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:35.232794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36888b-6ed3-4ba3-8bac-70053c26e335 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:35.233096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36888b-6ed3-4ba3-8bac-70053c26e335 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:35.233357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36888b-6ed3-4ba3-8bac-70053c26e335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:35.234933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca36888b-6ed3-4ba3-8bac-70053c26e335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:35.362887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36888b-6ed3-4ba3-8bac-70053c26e335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:35.364237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36888b-6ed3-4ba3-8bac-70053c26e335 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:35.384371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 728/1449] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:56:37.395149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336120-09a9-4a86-9e67-c1e36a2af3b6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:37.395716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336120-09a9-4a86-9e67-c1e36a2af3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:37.395716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336120-09a9-4a86-9e67-c1e36a2af3b6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:37.397865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:37.404452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1e4b8-0153-495d-bdaf-2a45ae4b37d4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:37.404895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1e4b8-0153-495d-bdaf-2a45ae4b37d4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:37.405028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1e4b8-0153-495d-bdaf-2a45ae4b37d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:37.478111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4af1e4b8-0153-495d-bdaf-2a45ae4b37d4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:37.479310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4af1e4b8-0153-495d-bdaf-2a45ae4b37d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:37.503055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:37.585182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:37.870740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336120-09a9-4a86-9e67-c1e36a2af3b6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:37.873334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48336120-09a9-4a86-9e67-c1e36a2af3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:37.992963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336120-09a9-4a86-9e67-c1e36a2af3b6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:38.014421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:38.072713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010d1b-0d92-404d-944c-138ae2c2d7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:38.073342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010d1b-0d92-404d-944c-138ae2c2d7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:38.073610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010d1b-0d92-404d-944c-138ae2c2d7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:38.073875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010d1b-0d92-404d-944c-138ae2c2d7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:38.075462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b9010d1b-0d92-404d-944c-138ae2c2d7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:38.197063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010d1b-0d92-404d-944c-138ae2c2d7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:38.198720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010d1b-0d92-404d-944c-138ae2c2d7a7 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:38.217737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 723/1452] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:40.264663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6a3f-3db2-47bf-86db-fae5a2d77fd8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:40.265270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6a3f-3db2-47bf-86db-fae5a2d77fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:40.265270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6a3f-3db2-47bf-86db-fae5a2d77fd8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:40.267172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:40.275504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c153a-8949-4172-8c85-0744344409d3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:40.275978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c153a-8949-4172-8c85-0744344409d3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:40.276077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c153a-8949-4172-8c85-0744344409d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:40.342438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:40.345600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c68c153a-8949-4172-8c85-0744344409d3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:40.347463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c68c153a-8949-4172-8c85-0744344409d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:40.451080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:56:40.737915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c6a3f-3db2-47bf-86db-fae5a2d77fd8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:40.739478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f66c6a3f-3db2-47bf-86db-fae5a2d77fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:40.878515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c6a3f-3db2-47bf-86db-fae5a2d77fd8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:40.934303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:40.960164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4378c-bad3-4ce1-ab70-0eac321c9225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:40.960765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4378c-bad3-4ce1-ab70-0eac321c9225 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:40.961068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4378c-bad3-4ce1-ab70-0eac321c9225 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:40.961327 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4378c-bad3-4ce1-ab70-0eac321c9225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:40.962897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57e4378c-bad3-4ce1-ab70-0eac321c9225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:41.075599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4378c-bad3-4ce1-ab70-0eac321c9225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:41.077094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4378c-bad3-4ce1-ab70-0eac321c9225 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:41.095653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 731/1455] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:43.058171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f07d6-cd9e-49a8-91b6-1d1af85bc97a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:43.058701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f07d6-cd9e-49a8-91b6-1d1af85bc97a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:43.058701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f07d6-cd9e-49a8-91b6-1d1af85bc97a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:43.060066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:43.065677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268cf8f-7861-469a-8640-f953220d18ce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:43.066081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268cf8f-7861-469a-8640-f953220d18ce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:43.066204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268cf8f-7861-469a-8640-f953220d18ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:43.148003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e268cf8f-7861-469a-8640-f953220d18ce None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:43.149294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e268cf8f-7861-469a-8640-f953220d18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:43.180598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:43.253756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:43.537046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f07d6-cd9e-49a8-91b6-1d1af85bc97a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:43.538632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ad0f07d6-cd9e-49a8-91b6-1d1af85bc97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:43.649650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f07d6-cd9e-49a8-91b6-1d1af85bc97a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:43.679858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:43.726079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a05ae-cfff-4d13-b831-cf5c7286ea0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:43.726697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a05ae-cfff-4d13-b831-cf5c7286ea0b service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:43.726973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a05ae-cfff-4d13-b831-cf5c7286ea0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:43.727239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a05ae-cfff-4d13-b831-cf5c7286ea0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:43.728838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-397a05ae-cfff-4d13-b831-cf5c7286ea0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:43.846030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a05ae-cfff-4d13-b831-cf5c7286ea0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:43.847405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a05ae-cfff-4d13-b831-cf5c7286ea0b service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:43.866857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 726/1458] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:45.942554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ddae5-a390-485f-81e4-c26600ccc13b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:45.943178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ddae5-a390-485f-81e4-c26600ccc13b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:45.943178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ddae5-a390-485f-81e4-c26600ccc13b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:45.944441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:45.950368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7b18-565c-4bc0-8e4d-d27960cf498d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:45.950937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7b18-565c-4bc0-8e4d-d27960cf498d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:45.950937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7b18-565c-4bc0-8e4d-d27960cf498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:46.024341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1a2c7b18-565c-4bc0-8e4d-d27960cf498d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:46.025508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1a2c7b18-565c-4bc0-8e4d-d27960cf498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:46.033930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:46.131755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:46.420566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ddae5-a390-485f-81e4-c26600ccc13b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:46.423090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f85ddae5-a390-485f-81e4-c26600ccc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:46.551442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ddae5-a390-485f-81e4-c26600ccc13b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:46.615629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:46.634857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5be43-e3b0-4ea1-8f7d-2ad96e4f1f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:46.635458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5be43-e3b0-4ea1-8f7d-2ad96e4f1f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:46.635729 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5be43-e3b0-4ea1-8f7d-2ad96e4f1f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:46.635993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5be43-e3b0-4ea1-8f7d-2ad96e4f1f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:46.637621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1cf5be43-e3b0-4ea1-8f7d-2ad96e4f1f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:46.755870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5be43-e3b0-4ea1-8f7d-2ad96e4f1f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:46.757969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5be43-e3b0-4ea1-8f7d-2ad96e4f1f1e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:46.779370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 734/1461] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:48.762503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbba72e-691e-40c7-aabb-c647f30012dc None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:48.762953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbba72e-691e-40c7-aabb-c647f30012dc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:48.763067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbba72e-691e-40c7-aabb-c647f30012dc None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:48.765182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:48.770689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf75c-1f92-48b1-b333-a3c3ef9dba05 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:48.771135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf75c-1f92-48b1-b333-a3c3ef9dba05 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:48.771239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf75c-1f92-48b1-b333-a3c3ef9dba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:48.839975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4edcf75c-1f92-48b1-b333-a3c3ef9dba05 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:48.841205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4edcf75c-1f92-48b1-b333-a3c3ef9dba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:48.893777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:48.968881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:49.262254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbba72e-691e-40c7-aabb-c647f30012dc None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:49.265151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3bbba72e-691e-40c7-aabb-c647f30012dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:49.391846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbba72e-691e-40c7-aabb-c647f30012dc None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:49.433728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:49.476643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826cab2-2165-4ff2-a892-324dac149e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:49.477313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826cab2-2165-4ff2-a892-324dac149e15 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:49.477588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826cab2-2165-4ff2-a892-324dac149e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:49.477855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826cab2-2165-4ff2-a892-324dac149e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:49.479471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7826cab2-2165-4ff2-a892-324dac149e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:49.600388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826cab2-2165-4ff2-a892-324dac149e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:49.603165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826cab2-2165-4ff2-a892-324dac149e15 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:49.623938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 729/1464] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:51.603851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e35ee-4f50-4ae9-851c-06453dab59e3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:51.604789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e35ee-4f50-4ae9-851c-06453dab59e3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:51.604789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e35ee-4f50-4ae9-851c-06453dab59e3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:51.606904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:51.614140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e394-113f-4e73-a90c-fe2cc9532d86 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:51.614800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e394-113f-4e73-a90c-fe2cc9532d86 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:51.614971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e394-113f-4e73-a90c-fe2cc9532d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:51.696316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-05e8e394-113f-4e73-a90c-fe2cc9532d86 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:51.697590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-05e8e394-113f-4e73-a90c-fe2cc9532d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:51.715999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:51.800949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:52.081940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e35ee-4f50-4ae9-851c-06453dab59e3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:52.083515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b7e35ee-4f50-4ae9-851c-06453dab59e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:52.206915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e35ee-4f50-4ae9-851c-06453dab59e3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:52.277719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:52.285691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357698-61de-448b-993f-8bbf4f914e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:52.286299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357698-61de-448b-993f-8bbf4f914e36 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:52.286568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357698-61de-448b-993f-8bbf4f914e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:52.286797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357698-61de-448b-993f-8bbf4f914e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:52.288413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7e357698-61de-448b-993f-8bbf4f914e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:52.414363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357698-61de-448b-993f-8bbf4f914e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:52.415720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357698-61de-448b-993f-8bbf4f914e36 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:52.434151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 737/1467] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:56:54.361818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e7d2-3d6c-47c3-9e68-fa076eed1021 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:54.362424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e7d2-3d6c-47c3-9e68-fa076eed1021 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:54.362424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e7d2-3d6c-47c3-9e68-fa076eed1021 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:54.364391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:56:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:54.374395 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd86ee1-2407-4fae-80c0-e050fef69b75 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:54.374846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd86ee1-2407-4fae-80c0-e050fef69b75 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:54.375114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd86ee1-2407-4fae-80c0-e050fef69b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:54.452340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4dd86ee1-2407-4fae-80c0-e050fef69b75 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:54.453605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4dd86ee1-2407-4fae-80c0-e050fef69b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:54.506698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:54.565143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:56:54.844550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e7d2-3d6c-47c3-9e68-fa076eed1021 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:54.847346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-89f4e7d2-3d6c-47c3-9e68-fa076eed1021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:54.968955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e7d2-3d6c-47c3-9e68-fa076eed1021 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:55.022491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:55.056244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961fd53-55b2-4d1f-9ac7-1dd5ff222dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:55.056890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961fd53-55b2-4d1f-9ac7-1dd5ff222dbc service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:55.057153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961fd53-55b2-4d1f-9ac7-1dd5ff222dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:55.057420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961fd53-55b2-4d1f-9ac7-1dd5ff222dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:55.059044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0961fd53-55b2-4d1f-9ac7-1dd5ff222dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:55.182495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961fd53-55b2-4d1f-9ac7-1dd5ff222dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:55.183925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961fd53-55b2-4d1f-9ac7-1dd5ff222dbc service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:55.203765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 732/1470] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:57:04.563139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=22 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:05.200713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=66 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:14.801674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746013bc-6728-4f64-b61d-a602258ff849 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:14.802244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746013bc-6728-4f64-b61d-a602258ff849 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:14.802244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746013bc-6728-4f64-b61d-a602258ff849 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:14.804373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 739/1471] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:14.812607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70094f2-8753-42c5-a06f-f2d90e1f0175 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:14.813374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70094f2-8753-42c5-a06f-f2d90e1f0175 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:14.813494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70094f2-8753-42c5-a06f-f2d90e1f0175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:14.899145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b70094f2-8753-42c5-a06f-f2d90e1f0175 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:14.900383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b70094f2-8753-42c5-a06f-f2d90e1f0175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:15.010470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 733/1472] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:57:15.321291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdb76-f1fe-41c7-a8a7-2fdd0fde4d91 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:15.321696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdb76-f1fe-41c7-a8a7-2fdd0fde4d91 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:15.322058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdb76-f1fe-41c7-a8a7-2fdd0fde4d91 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:15.324039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 740/1473] 10.222.0.89 () {54 vars in 967 bytes} [Tue Aug 30 00:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:15.329157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73af2a-99de-4571-be38-8d9ad06784bc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:15.329438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73af2a-99de-4571-be38-8d9ad06784bc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:15.329707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73af2a-99de-4571-be38-8d9ad06784bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:15.409713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0c73af2a-99de-4571-be38-8d9ad06784bc None None] MFA Rules not processed for user `1c0449abfbe044b3aff4f24a5f1b7b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:15.410917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0c73af2a-99de-4571-be38-8d9ad06784bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:15.431897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:15.489611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 734/1474] 10.222.0.89 () {58 vars in 1064 bytes} [Tue Aug 30 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:57:15.499979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcdb76-f1fe-41c7-a8a7-2fdd0fde4d91 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:57:15.501663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0afcdb76-f1fe-41c7-a8a7-2fdd0fde4d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:15.622362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcdb76-f1fe-41c7-a8a7-2fdd0fde4d91 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:57:15.702334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e169d2-b273-47e6-a9c2-ff2d7469393d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:57:15.702947 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e169d2-b273-47e6-a9c2-ff2d7469393d service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:15.703220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e169d2-b273-47e6-a9c2-ff2d7469393d service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:15.703487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e169d2-b273-47e6-a9c2-ff2d7469393d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:15.705163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b4e169d2-b273-47e6-a9c2-ff2d7469393d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:15.771531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:15.831223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e169d2-b273-47e6-a9c2-ff2d7469393d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:57:15.832677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e169d2-b273-47e6-a9c2-ff2d7469393d service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:57:15.851725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 741/1475] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:57:17.883433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a09f-f96a-435b-ae67-19829634cd2f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:17.884328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a09f-f96a-435b-ae67-19829634cd2f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:17.884328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a09f-f96a-435b-ae67-19829634cd2f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:17.886523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 735/1476] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:57:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:17.894510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0054d-52d0-4f40-9ba9-97fd67cd94b6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:17.894968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0054d-52d0-4f40-9ba9-97fd67cd94b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:17.895072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0054d-52d0-4f40-9ba9-97fd67cd94b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:17.965015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aaf0054d-52d0-4f40-9ba9-97fd67cd94b6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:17.966251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aaf0054d-52d0-4f40-9ba9-97fd67cd94b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:18.072922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 742/1477] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:57:18.359316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3a09f-f96a-435b-ae67-19829634cd2f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:57:18.361565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e5b3a09f-f96a-435b-ae67-19829634cd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:18.497592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3a09f-f96a-435b-ae67-19829634cd2f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:57:18.547277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:18.603029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398f0b8-397b-4d76-9f03-a168a85f9176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:57:18.603645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398f0b8-397b-4d76-9f03-a168a85f9176 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:18.603923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398f0b8-397b-4d76-9f03-a168a85f9176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:18.604182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398f0b8-397b-4d76-9f03-a168a85f9176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:18.604886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398f0b8-397b-4d76-9f03-a168a85f9176 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:57:18.606677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-9398f0b8-397b-4d76-9f03-a168a85f9176 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:57:18.606677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 00:57:18.606677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 00:57:18.607817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398f0b8-397b-4d76-9f03-a168a85f9176 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:57:18.627506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 736/1478] 10.222.0.89 () {56 vars in 1108 bytes} [Tue Aug 30 00:57:18 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:57:20.628567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d516-18ac-4db1-836f-9c0f9f4dd1cf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:20.629482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d516-18ac-4db1-836f-9c0f9f4dd1cf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:20.629482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d516-18ac-4db1-836f-9c0f9f4dd1cf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:20.632118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 743/1479] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:57:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:20.638545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1376f1-cb15-4785-b2a6-30ced3320dda None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:20.639337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1376f1-cb15-4785-b2a6-30ced3320dda None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:20.639535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1376f1-cb15-4785-b2a6-30ced3320dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:20.719256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1a1376f1-cb15-4785-b2a6-30ced3320dda None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:20.720747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1a1376f1-cb15-4785-b2a6-30ced3320dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:20.825514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 737/1480] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:57:21.123642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d516-18ac-4db1-836f-9c0f9f4dd1cf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:57:21.126135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ce1d516-18ac-4db1-836f-9c0f9f4dd1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:21.136482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:21.287499 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d516-18ac-4db1-836f-9c0f9f4dd1cf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:57:21.384685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:21.420393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d37c56-ac59-42fd-80d5-efa161cc9c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:57:21.421058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d37c56-ac59-42fd-80d5-efa161cc9c2f service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:21.421331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d37c56-ac59-42fd-80d5-efa161cc9c2f service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:21.421593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d37c56-ac59-42fd-80d5-efa161cc9c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:21.423449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-06d37c56-ac59-42fd-80d5-efa161cc9c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:21.518075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d37c56-ac59-42fd-80d5-efa161cc9c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:57:21.519691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d37c56-ac59-42fd-80d5-efa161cc9c2f service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:57:21.538420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 744/1481] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:57:23.698573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc59d-2a7f-459f-92fa-510d1473e8a6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:23.699167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc59d-2a7f-459f-92fa-510d1473e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:23.699167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc59d-2a7f-459f-92fa-510d1473e8a6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:23.700444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 738/1482] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:23.706610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c9f1c-2130-4953-9138-6ed61a95b408 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:23.707056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c9f1c-2130-4953-9138-6ed61a95b408 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:23.707159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c9f1c-2130-4953-9138-6ed61a95b408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:23.781675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d56c9f1c-2130-4953-9138-6ed61a95b408 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:23.782908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d56c9f1c-2130-4953-9138-6ed61a95b408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:23.833695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:23.895088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 745/1483] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:57:24.202281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc59d-2a7f-459f-92fa-510d1473e8a6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:57:24.204325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-618cc59d-2a7f-459f-92fa-510d1473e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:24.241333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:24.329999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc59d-2a7f-459f-92fa-510d1473e8a6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:57:24.409664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c39ea8-ee3a-4d1b-aa18-8b6cd3390254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:57:24.410283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c39ea8-ee3a-4d1b-aa18-8b6cd3390254 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:24.410557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c39ea8-ee3a-4d1b-aa18-8b6cd3390254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:24.410821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c39ea8-ee3a-4d1b-aa18-8b6cd3390254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:24.412427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-54c39ea8-ee3a-4d1b-aa18-8b6cd3390254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:24.497766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:24.537601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c39ea8-ee3a-4d1b-aa18-8b6cd3390254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:57:24.539045 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c39ea8-ee3a-4d1b-aa18-8b6cd3390254 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:57:24.560012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 739/1484] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:57:26.529169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ee46c-1aa4-4baf-8ccc-2ebe2e976b54 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:26.529648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ee46c-1aa4-4baf-8ccc-2ebe2e976b54 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:26.529648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ee46c-1aa4-4baf-8ccc-2ebe2e976b54 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:26.531076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 746/1485] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:26.537584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbdafe-ff0a-4957-800a-fcbec8973b3a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:26.538049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbdafe-ff0a-4957-800a-fcbec8973b3a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:26.538156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbdafe-ff0a-4957-800a-fcbec8973b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:26.613601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-aafbdafe-ff0a-4957-800a-fcbec8973b3a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:26.614814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aafbdafe-ff0a-4957-800a-fcbec8973b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:26.725307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 740/1486] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:57:27.011536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ee46c-1aa4-4baf-8ccc-2ebe2e976b54 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:57:27.014112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cb5ee46c-1aa4-4baf-8ccc-2ebe2e976b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:27.128158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ee46c-1aa4-4baf-8ccc-2ebe2e976b54 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:57:27.207388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:27.209759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1589e-fbeb-4a33-ab0a-9512cc5090bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:57:27.210455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1589e-fbeb-4a33-ab0a-9512cc5090bd service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:27.210730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1589e-fbeb-4a33-ab0a-9512cc5090bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:27.210997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1589e-fbeb-4a33-ab0a-9512cc5090bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:27.213067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7e1589e-fbeb-4a33-ab0a-9512cc5090bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:27.329814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1589e-fbeb-4a33-ab0a-9512cc5090bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:57:27.331489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1589e-fbeb-4a33-ab0a-9512cc5090bd service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:57:27.351584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 747/1487] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:57:29.367317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747a7e-c70e-4e11-be38-8bb0cbac8127 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:29.367920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747a7e-c70e-4e11-be38-8bb0cbac8127 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:29.367920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747a7e-c70e-4e11-be38-8bb0cbac8127 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:29.370049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 741/1488] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:57:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:29.375937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0d3d-3890-41de-8360-e49572b1b45c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:29.376833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0d3d-3890-41de-8360-e49572b1b45c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:29.376833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0d3d-3890-41de-8360-e49572b1b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:29.451615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c4dc0d3d-3890-41de-8360-e49572b1b45c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:29.452840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4dc0d3d-3890-41de-8360-e49572b1b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:29.514823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:29.571232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 748/1489] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:57:29.875843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a747a7e-c70e-4e11-be38-8bb0cbac8127 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:57:29.878646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4a747a7e-c70e-4e11-be38-8bb0cbac8127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:29.920884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:29.991886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a747a7e-c70e-4e11-be38-8bb0cbac8127 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:57:30.071964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0aeca-ba13-4e6d-ad93-a8ad475db5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:57:30.072489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0aeca-ba13-4e6d-ad93-a8ad475db5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:30.072761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0aeca-ba13-4e6d-ad93-a8ad475db5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:30.073060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0aeca-ba13-4e6d-ad93-a8ad475db5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:30.074663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88a0aeca-ba13-4e6d-ad93-a8ad475db5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:30.160043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:30.190550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0aeca-ba13-4e6d-ad93-a8ad475db5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:57:30.191966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0aeca-ba13-4e6d-ad93-a8ad475db5b7 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:57:30.210270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 742/1490] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:57:32.393474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd76c-3977-4534-be0c-3a7f79e0155a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:32.394110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd76c-3977-4534-be0c-3a7f79e0155a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:32.394110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd76c-3977-4534-be0c-3a7f79e0155a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:32.395447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 749/1491] 10.222.0.89 () {54 vars in 927 bytes} [Tue Aug 30 00:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:57:32.401899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cd011-cec2-44da-8311-52aad528d534 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:32.402652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cd011-cec2-44da-8311-52aad528d534 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:32.402834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cd011-cec2-44da-8311-52aad528d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:32.485408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-167cd011-cec2-44da-8311-52aad528d534 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:57:32.486919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-167cd011-cec2-44da-8311-52aad528d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:32.593953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 743/1492] 10.222.0.89 () {58 vars in 1024 bytes} [Tue Aug 30 00:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:57:32.883590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acd76c-3977-4534-be0c-3a7f79e0155a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:57:32.886111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-60acd76c-3977-4534-be0c-3a7f79e0155a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:33.001235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acd76c-3977-4534-be0c-3a7f79e0155a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:57:33.080866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9c949-065a-4ee6-b078-3b42a61a610d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:57:33.081401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c949-065a-4ee6-b078-3b42a61a610d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:57:33.081675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c949-065a-4ee6-b078-3b42a61a610d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:57:33.081938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c949-065a-4ee6-b078-3b42a61a610d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:57:33.083599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27f9c949-065a-4ee6-b078-3b42a61a610d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:57:33.093108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:33.199592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9c949-065a-4ee6-b078-3b42a61a610d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:57:33.201104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9c949-065a-4ee6-b078-3b42a61a610d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:57:33.219747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 750/1493] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:57:42.591833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=82 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:43.217659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=50 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:46.505787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:46.506725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:46.506725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:46.599826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:46.601101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:46.723663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 744/1494] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 00:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:58:46.732302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ed59-b092-42b0-8fdf-c365827bc275 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:46.732956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ed59-b092-42b0-8fdf-c365827bc275 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:46.732956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39ed59-b092-42b0-8fdf-c365827bc275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:46.824314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ef39ed59-b092-42b0-8fdf-c365827bc275 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:46.825485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef39ed59-b092-42b0-8fdf-c365827bc275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:46.948384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 751/1495] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 00:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:58:46.953953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:46.955180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:46.968159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b41b-712d-4fe6-8487-b6bc591ef77a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.037910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.075748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.076276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.076547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.076847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.077495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:47.077788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:47.079031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:47.079031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 00:58:47.079031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 00:58:47.079930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:47.091984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 745/1496] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 00:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:47.100836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ed59-b092-42b0-8fdf-c365827bc275 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.110486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39ed59-b092-42b0-8fdf-c365827bc275 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.180478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.217506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.218119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.218393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.218657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.219310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:47.221149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:47.221149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: warnings.warn(msg) Aug 30 00:58:47.221149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: Aug 30 00:58:47.222599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:47.286450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 752/1497] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 00:58:47 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:47.291317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.293004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:47.334008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d91c9c-690f-434b-9753-a27c0ec7f5e8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.454562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.455166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.455450 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.455715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.456345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:47.457408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:47.457408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 00:58:47.457408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 00:58:47.458618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:47.517637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 746/1498] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 00:58:47 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:47.522169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.523817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:47.592845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d68346-aedc-4bd5-9e11-116e14e49421 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.683830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.699927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.700819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.701198 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.701565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.702511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:47.704106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:47.704106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: warnings.warn(msg) Aug 30 00:58:47.704106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: Aug 30 00:58:47.705462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:47.719493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 753/1499] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 00:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:58:47.723884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.725561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:47.738077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb0b9-6ed0-4bcd-86e8-88378bd4aa24 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:47.765645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:47.844844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bb973-49ce-4bbb-8c70-d9a49a1ce928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:47.845385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bb973-49ce-4bbb-8c70-d9a49a1ce928 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.845657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bb973-49ce-4bbb-8c70-d9a49a1ce928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.845924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bb973-49ce-4bbb-8c70-d9a49a1ce928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.846580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bb973-49ce-4bbb-8c70-d9a49a1ce928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:47.847655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-ee8bb973-49ce-4bbb-8c70-d9a49a1ce928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:47.847655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 00:58:47.847655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 00:58:47.848545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bb973-49ce-4bbb-8c70-d9a49a1ce928 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:47.861688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 747/1500] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 00:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:58:47.867041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:47.868639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:47.902799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65bda7-8066-4ac1-bf16-29c0eb5562e1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.004685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f455-e452-48a5-b071-191a0ea70096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.005392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f455-e452-48a5-b071-191a0ea70096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.005662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f455-e452-48a5-b071-191a0ea70096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.005923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f455-e452-48a5-b071-191a0ea70096 admin admin] PATH_INFO: `/v3/projects/7d0a36c0e2d8428ca1db916f8df4dbfa/users/91e101e8f5a247659287c91b821182ef/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.029939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f455-e452-48a5-b071-191a0ea70096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0a36c0e2d8428ca1db916f8df4dbfa, user_id=91e101e8f5a247659287c91b821182ef, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.030965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-9ab4f455-e452-48a5-b071-191a0ea70096 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:48.030965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: warnings.warn(msg) Aug 30 00:58:48.030965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: Aug 30 00:58:48.032913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f455-e452-48a5-b071-191a0ea70096 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.064969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 754/1501] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 00:58:47 2022] PUT /identity/v3/projects/7d0a36c0e2d8428ca1db916f8df4dbfa/users/91e101e8f5a247659287c91b821182ef/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:48.078347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fa2e-6e22-4712-b33b-fd272e44ba52 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.078589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fa2e-6e22-4712-b33b-fd272e44ba52 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.078880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441fa2e-6e22-4712-b33b-fd272e44ba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.147492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6441fa2e-6e22-4712-b33b-fd272e44ba52 None None] MFA Rules not processed for user `91e101e8f5a247659287c91b821182ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:48.148641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6441fa2e-6e22-4712-b33b-fd272e44ba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:48.243276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 748/1502] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 00:58:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:58:48.258289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432197ce-46f5-43de-b352-febb6c91e3d3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.258579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432197ce-46f5-43de-b352-febb6c91e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.258898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432197ce-46f5-43de-b352-febb6c91e3d3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.260913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 755/1503] 10.222.0.89 () {54 vars in 964 bytes} [Tue Aug 30 00:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:48.265889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317528-39be-43f3-8978-06336bd2c5f8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.266686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317528-39be-43f3-8978-06336bd2c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.266686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317528-39be-43f3-8978-06336bd2c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.300485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.352343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6a317528-39be-43f3-8978-06336bd2c5f8 None None] MFA Rules not processed for user `84fd8059995549a892fe769eb07dc322`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:48.353595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a317528-39be-43f3-8978-06336bd2c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:48.445408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 749/1504] 10.222.0.89 () {58 vars in 1061 bytes} [Tue Aug 30 00:58:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:58:48.453743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432197ce-46f5-43de-b352-febb6c91e3d3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.455280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-432197ce-46f5-43de-b352-febb6c91e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:48.510040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.566574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432197ce-46f5-43de-b352-febb6c91e3d3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.643243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.643842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.644109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.644374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.646390 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:48.761849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.763298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.766779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.781958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 756/1505] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:58:48.827664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308a73-8e66-4545-ac67-ca8610d604f3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.828140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308a73-8e66-4545-ac67-ca8610d604f3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.828259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308a73-8e66-4545-ac67-ca8610d604f3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.829541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 750/1506] 10.222.0.89 () {52 vars in 830 bytes} [Tue Aug 30 00:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:48.833755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.834978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:48.942356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3bbad-5841-4c0a-8452-3bd4dd2eae59 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.053484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:49.054029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.054299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.054563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] PATH_INFO: `/v3/users/91e101e8f5a247659287c91b821182ef` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.068649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e101e8f5a247659287c91b821182ef)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:49.069793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:49.069793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: warnings.warn(msg) Aug 30 00:58:49.069793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: Aug 30 00:58:49.071022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:49.081646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.142234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e101e8f5a247659287c91b821182ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:49.167869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e101e8f5a247659287c91b821182ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:49.182654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e101e8f5a247659287c91b821182ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:49.183311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e101e8f5a247659287c91b821182ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:49.183740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e101e8f5a247659287c91b821182ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:49.199558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 757/1507] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 00:58:48 2022] DELETE /identity/v3/users/91e101e8f5a247659287c91b821182ef => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:49.204325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.204632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.204922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.265542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:49.266891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:49.345359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.359161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 751/1508] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 00:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:58:49.370294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:49.371528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:49.484244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30015f91-5834-4b44-b92d-96c256747b32 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:49.670378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:49.692710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77bb0-09bd-4f00-88f1-4d0926c65ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:49.693365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77bb0-09bd-4f00-88f1-4d0926c65ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:49.693641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77bb0-09bd-4f00-88f1-4d0926c65ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:49.693915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77bb0-09bd-4f00-88f1-4d0926c65ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:49.695509 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3de77bb0-09bd-4f00-88f1-4d0926c65ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:49.813188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de77bb0-09bd-4f00-88f1-4d0926c65ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:49.814648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de77bb0-09bd-4f00-88f1-4d0926c65ef3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:49.834379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 758/1509] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 00:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:58:50.273556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:50.274785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:50.287391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e249754-4061-46b1-9fec-ab887a67db84 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:50.395332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:50.395962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:50.396242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:50.396515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] PATH_INFO: `/v3/projects/7d0a36c0e2d8428ca1db916f8df4dbfa` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:50.407164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0a36c0e2d8428ca1db916f8df4dbfa)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:50.408195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:58:50.408195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 00:58:50.408195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 00:58:50.409424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:50.484232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0a36c0e2d8428ca1db916f8df4dbfa', 'request_id': 'req-80dda45d-7ccd-469d-81be-c53d623303c0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:50.491656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0a36c0e2d8428ca1db916f8df4dbfa', 'request_id': 'req-80dda45d-7ccd-469d-81be-c53d623303c0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:50.503620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0a36c0e2d8428ca1db916f8df4dbfa', 'request_id': 'req-80dda45d-7ccd-469d-81be-c53d623303c0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:50.534991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] The token cache is being invalidate because project 7d0a36c0e2d8428ca1db916f8df4dbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:58:50.535307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:50.535931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-80dda45d-7ccd-469d-81be-c53d623303c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:58:50.537556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 752/1510] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 00:58:50 2022] DELETE /identity/v3/projects/7d0a36c0e2d8428ca1db916f8df4dbfa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:59.834075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=62 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:00.532913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:25.652668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd920-7bce-45be-aa87-ca834f859865 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.653347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd920-7bce-45be-aa87-ca834f859865 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.653347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd920-7bce-45be-aa87-ca834f859865 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.655307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:25.661677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16701a37-2060-4de8-a100-2383810e0832 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:25.662478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16701a37-2060-4de8-a100-2383810e0832 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:25.662653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16701a37-2060-4de8-a100-2383810e0832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:25.760757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-16701a37-2060-4de8-a100-2383810e0832 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:25.762431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-16701a37-2060-4de8-a100-2383810e0832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:25.879487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:26.057537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdd920-7bce-45be-aa87-ca834f859865 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:26.060697 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a5cdd920-7bce-45be-aa87-ca834f859865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:26.193168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdd920-7bce-45be-aa87-ca834f859865 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:26.203894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3958d-06ee-4427-9818-76491ba4f8f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:26.204854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3958d-06ee-4427-9818-76491ba4f8f6 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:26.205136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3958d-06ee-4427-9818-76491ba4f8f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:26.205429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3958d-06ee-4427-9818-76491ba4f8f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:26.217314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3958d-06ee-4427-9818-76491ba4f8f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:26.219320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3958d-06ee-4427-9818-76491ba4f8f6 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:26.229205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 760/1513] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:00:27.054813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bdff4-07f8-44ef-8a01-e1a533685095 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.055410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bdff4-07f8-44ef-8a01-e1a533685095 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.055410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bdff4-07f8-44ef-8a01-e1a533685095 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.057062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:27.063301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d2d9-bdb2-41d3-93c7-0e7afe2b1ccc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.063782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d2d9-bdb2-41d3-93c7-0e7afe2b1ccc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.063782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d2d9-bdb2-41d3-93c7-0e7afe2b1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.087214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d939d2d9-bdb2-41d3-93c7-0e7afe2b1ccc None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:27.088773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d939d2d9-bdb2-41d3-93c7-0e7afe2b1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:27.099184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:27.253015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bdff4-07f8-44ef-8a01-e1a533685095 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:27.273084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bdff4-07f8-44ef-8a01-e1a533685095 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:27.281403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5723cdd-ea39-4f17-801a-4afe4bc452fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:27.282154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5723cdd-ea39-4f17-801a-4afe4bc452fe service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:27.282433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5723cdd-ea39-4f17-801a-4afe4bc452fe service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:27.282704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5723cdd-ea39-4f17-801a-4afe4bc452fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:27.292289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5723cdd-ea39-4f17-801a-4afe4bc452fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:27.293966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5723cdd-ea39-4f17-801a-4afe4bc452fe service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:27.305668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 755/1516] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:00:28.148197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bfa6-e8aa-46b2-819a-fac07b1dcb53 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.148829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bfa6-e8aa-46b2-819a-fac07b1dcb53 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.148829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558bfa6-e8aa-46b2-819a-fac07b1dcb53 None None] PATH_INFO: `/v3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.150100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 762/1517] 10.222.0.88 () {54 vars in 925 bytes} [Tue Aug 30 01:00:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:00:28.158594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4bbc3-423d-4c0f-9964-1a830aae711a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:28.159041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4bbc3-423d-4c0f-9964-1a830aae711a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:28.159145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4bbc3-423d-4c0f-9964-1a830aae711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:28.226895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-07c4bbc3-423d-4c0f-9964-1a830aae711a None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:28.228107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-07c4bbc3-423d-4c0f-9964-1a830aae711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:28.247165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:28.305412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 756/1518] 10.222.0.88 () {58 vars in 1015 bytes} [Tue Aug 30 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:32.228824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951040-29db-4bab-b640-a9270e725115 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:32.229407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951040-29db-4bab-b640-a9270e725115 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:32.229407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951040-29db-4bab-b640-a9270e725115 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:32.230684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 763/1519] 10.222.0.89 () {54 vars in 961 bytes} [Tue Aug 30 01:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:32.239608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f32b4-475e-4ea1-971b-4f09bf1f4272 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:32.240369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f32b4-475e-4ea1-971b-4f09bf1f4272 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:32.240556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f32b4-475e-4ea1-971b-4f09bf1f4272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:32.266861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9d8f32b4-475e-4ea1-971b-4f09bf1f4272 None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:32.268063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9d8f32b4-475e-4ea1-971b-4f09bf1f4272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:32.277989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 757/1520] 10.222.0.89 () {58 vars in 1058 bytes} [Tue Aug 30 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:32.285988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951040-29db-4bab-b640-a9270e725115 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:32.301794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951040-29db-4bab-b640-a9270e725115 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:32.308133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd82d5-d925-4573-9587-ede444d22dad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:32.308754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd82d5-d925-4573-9587-ede444d22dad service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:32.309108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd82d5-d925-4573-9587-ede444d22dad service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:32.309378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd82d5-d925-4573-9587-ede444d22dad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:32.318336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd82d5-d925-4573-9587-ede444d22dad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:32.319907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd82d5-d925-4573-9587-ede444d22dad service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:32.329421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 764/1521] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:00:38.618780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3344-8292-452e-8b86-2c00886465d3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:38.619378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3344-8292-452e-8b86-2c00886465d3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:38.619378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3344-8292-452e-8b86-2c00886465d3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:38.620672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:38.626401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664746f-4bed-429a-b2ec-781133f29ce1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:38.626845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664746f-4bed-429a-b2ec-781133f29ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:38.626963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664746f-4bed-429a-b2ec-781133f29ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:38.653948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8664746f-4bed-429a-b2ec-781133f29ce1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:38.655157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8664746f-4bed-429a-b2ec-781133f29ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:38.665110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:38.835605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3344-8292-452e-8b86-2c00886465d3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:38.852416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3344-8292-452e-8b86-2c00886465d3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:38.858489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853702-2800-429f-9e87-17c911168377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:38.859106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853702-2800-429f-9e87-17c911168377 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:38.859376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853702-2800-429f-9e87-17c911168377 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:38.859675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853702-2800-429f-9e87-17c911168377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:38.870968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97853702-2800-429f-9e87-17c911168377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:38.872783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97853702-2800-429f-9e87-17c911168377 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:38.887480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 759/1524] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:00:39.733158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8cab-48ba-4257-8324-667d040b0460 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.733785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8cab-48ba-4257-8324-667d040b0460 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.733785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8cab-48ba-4257-8324-667d040b0460 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.735080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:39.741355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b0645-9551-4087-9f5b-537ecb631257 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.742048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b0645-9551-4087-9f5b-537ecb631257 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.742187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b0645-9551-4087-9f5b-537ecb631257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.765701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-aa0b0645-9551-4087-9f5b-537ecb631257 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:39.766942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aa0b0645-9551-4087-9f5b-537ecb631257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:39.775742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:39.933278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8cab-48ba-4257-8324-667d040b0460 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:39.955750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b8cab-48ba-4257-8324-667d040b0460 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:39.962573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e38764-b3fe-437e-bc01-4f4b406cf75e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:39.963206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e38764-b3fe-437e-bc01-4f4b406cf75e service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:39.963486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e38764-b3fe-437e-bc01-4f4b406cf75e service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:39.963754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e38764-b3fe-437e-bc01-4f4b406cf75e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:39.972640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e38764-b3fe-437e-bc01-4f4b406cf75e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:39.974275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e38764-b3fe-437e-bc01-4f4b406cf75e service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:39.985949 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 767/1527] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:00:43.725893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599bf8-3d9f-45aa-ba6d-0984b306bfda None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:43.726471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599bf8-3d9f-45aa-ba6d-0984b306bfda None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:43.726471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599bf8-3d9f-45aa-ba6d-0984b306bfda None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:43.727882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:43.735276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863418e-eb68-4736-80ab-dc59dbc03af6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:43.737253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863418e-eb68-4736-80ab-dc59dbc03af6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:43.737253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863418e-eb68-4736-80ab-dc59dbc03af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:43.760094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7863418e-eb68-4736-80ab-dc59dbc03af6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:43.761363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7863418e-eb68-4736-80ab-dc59dbc03af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:43.769709 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:44.059112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d599bf8-3d9f-45aa-ba6d-0984b306bfda None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:44.061595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6d599bf8-3d9f-45aa-ba6d-0984b306bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:44.150804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d599bf8-3d9f-45aa-ba6d-0984b306bfda None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:44.154964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a68bf-83d9-4c70-979c-ee217b9673a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:44.155583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a68bf-83d9-4c70-979c-ee217b9673a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:44.155854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a68bf-83d9-4c70-979c-ee217b9673a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:44.156121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a68bf-83d9-4c70-979c-ee217b9673a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:44.165424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a68bf-83d9-4c70-979c-ee217b9673a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:44.166864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a68bf-83d9-4c70-979c-ee217b9673a2 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:44.176364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 762/1530] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:00:46.123633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1e82-511c-491e-9066-94d551de9917 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.124524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1e82-511c-491e-9066-94d551de9917 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.124524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1e82-511c-491e-9066-94d551de9917 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.126598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:00:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:46.133562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1e81-5ef4-4626-b221-ca5c788ad88c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.134014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1e81-5ef4-4626-b221-ca5c788ad88c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.134259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1e81-5ef4-4626-b221-ca5c788ad88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.157289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-786e1e81-5ef4-4626-b221-ca5c788ad88c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:46.158537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-786e1e81-5ef4-4626-b221-ca5c788ad88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:46.167652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:46.458135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea1e82-511c-491e-9066-94d551de9917 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:46.471433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea1e82-511c-491e-9066-94d551de9917 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:46.475302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4030fda-80ed-4555-9f99-8dfa67d9b666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:46.475894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030fda-80ed-4555-9f99-8dfa67d9b666 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:46.476176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030fda-80ed-4555-9f99-8dfa67d9b666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:46.476447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4030fda-80ed-4555-9f99-8dfa67d9b666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:46.485750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4030fda-80ed-4555-9f99-8dfa67d9b666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:46.487532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4030fda-80ed-4555-9f99-8dfa67d9b666 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:46.496844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 770/1533] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:00:50.017809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff54a0-dc5a-4d42-adfc-19ada8bbef13 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.018349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff54a0-dc5a-4d42-adfc-19ada8bbef13 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.018349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff54a0-dc5a-4d42-adfc-19ada8bbef13 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.019621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:50.025284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c978095-9bb9-4183-b147-21446064daeb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.025739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c978095-9bb9-4183-b147-21446064daeb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.025842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c978095-9bb9-4183-b147-21446064daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.034441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:50.047515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7c978095-9bb9-4183-b147-21446064daeb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:50.048757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7c978095-9bb9-4183-b147-21446064daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:50.057399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:50.614319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff54a0-dc5a-4d42-adfc-19ada8bbef13 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:50.617140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dcff54a0-dc5a-4d42-adfc-19ada8bbef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:50.696181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:50.711367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff54a0-dc5a-4d42-adfc-19ada8bbef13 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:50.714988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873608-6cd3-4c4d-898a-17dd560a6b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:50.715589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873608-6cd3-4c4d-898a-17dd560a6b01 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:50.715864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873608-6cd3-4c4d-898a-17dd560a6b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:50.716131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873608-6cd3-4c4d-898a-17dd560a6b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:50.725801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873608-6cd3-4c4d-898a-17dd560a6b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:50.727299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873608-6cd3-4c4d-898a-17dd560a6b01 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:50.736988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 765/1536] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:00:52.662018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d238-fa88-4cac-8ed8-d053c2e323ad None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.662552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d238-fa88-4cac-8ed8-d053c2e323ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.662552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d238-fa88-4cac-8ed8-d053c2e323ad None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.663896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:00:52.670322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeccef1-d4bc-43a5-aac3-abab317a2f56 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:52.670782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeccef1-d4bc-43a5-aac3-abab317a2f56 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:52.670887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeccef1-d4bc-43a5-aac3-abab317a2f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:52.692077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ebeccef1-d4bc-43a5-aac3-abab317a2f56 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:00:52.693332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ebeccef1-d4bc-43a5-aac3-abab317a2f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:52.702106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:00:53.275755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3d238-fa88-4cac-8ed8-d053c2e323ad None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:00:53.279057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2bd3d238-fa88-4cac-8ed8-d053c2e323ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:00:53.296943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3d238-fa88-4cac-8ed8-d053c2e323ad None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:00:53.303284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb41ba-4586-4ea0-9c0d-6819174a96ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:00:53.304144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb41ba-4586-4ea0-9c0d-6819174a96ef service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:00:53.304499 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb41ba-4586-4ea0-9c0d-6819174a96ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:00:53.304873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb41ba-4586-4ea0-9c0d-6819174a96ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:00:53.317086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb41ba-4586-4ea0-9c0d-6819174a96ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:00:53.318545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb41ba-4586-4ea0-9c0d-6819174a96ef service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:00:53.328394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 773/1539] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:01:02.686690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=11 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:03.323997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:27.010877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b2c0-1425-4624-a78f-d05f10105c25 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.011924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b2c0-1425-4624-a78f-d05f10105c25 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.012408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b2c0-1425-4624-a78f-d05f10105c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.040203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7246b2c0-1425-4624-a78f-d05f10105c25 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.041504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a142-9822-417c-8976-d316382a3dbf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.042068 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7246b2c0-1425-4624-a78f-d05f10105c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.042549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a142-9822-417c-8976-d316382a3dbf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.043026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a142-9822-417c-8976-d316382a3dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.056123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 767/1540] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:02:27.066479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7e7d-69c9-4899-9359-6e9b9bcedb19 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.066785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7e7d-69c9-4899-9359-6e9b9bcedb19 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.067027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7e7d-69c9-4899-9359-6e9b9bcedb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.080907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-71b8a142-9822-417c-8976-d316382a3dbf None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.082520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-71b8a142-9822-417c-8976-d316382a3dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.100074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b1ea7e7d-69c9-4899-9359-6e9b9bcedb19 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.100821 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 774/1541] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:02:27.101466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b1ea7e7d-69c9-4899-9359-6e9b9bcedb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.111218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e7f2b-a0b3-4d5e-bc99-b67a021eca1a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.111866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e7f2b-a0b3-4d5e-bc99-b67a021eca1a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.112352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e7f2b-a0b3-4d5e-bc99-b67a021eca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.116910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 768/1542] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:02:27.122367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7e7d-69c9-4899-9359-6e9b9bcedb19 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.138308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7e7d-69c9-4899-9359-6e9b9bcedb19 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.150176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.154944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.154944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.154944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.154944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:27.154944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.154944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.157018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-174e7f2b-a0b3-4d5e-bc99-b67a021eca1a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.158865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-174e7f2b-a0b3-4d5e-bc99-b67a021eca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.182912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 769/1543] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:02:27.185197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 775/1544] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:02:27.190063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.198458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e7f2b-a0b3-4d5e-bc99-b67a021eca1a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.206497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e50e7-f382-4a08-876d-fd3418b9f85c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.215301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e7f2b-a0b3-4d5e-bc99-b67a021eca1a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.219893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.220620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.220920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.221195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.221849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:27.222151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.223738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.225061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.225925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.226404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.226879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.227747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.230138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.251787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 770/1545] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:27.260639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.280825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1625-a748-4284-9d9f-86e81f88da01 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.297910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.298561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.298823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.299142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.299936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.301313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:02:27.301313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 01:02:27.301313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 01:02:27.302668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.317043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 776/1546] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:27.324388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.359482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 771/1547] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:27.363649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.495068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5572c-b972-446e-a28c-c13909ca7c6e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.523245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf848a-85b9-465d-9a53-dc3b8cd4c85a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.537440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abfc7d-99ee-4290-a2ef-a042ea65b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.538035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abfc7d-99ee-4290-a2ef-a042ea65b81c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.538311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abfc7d-99ee-4290-a2ef-a042ea65b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.538582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abfc7d-99ee-4290-a2ef-a042ea65b81c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.539361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abfc7d-99ee-4290-a2ef-a042ea65b81c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.541495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abfc7d-99ee-4290-a2ef-a042ea65b81c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.575601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 772/1548] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:27.581625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7f049-ac20-4bcd-9112-e7139aba0be7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.582307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7f049-ac20-4bcd-9112-e7139aba0be7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.582595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7f049-ac20-4bcd-9112-e7139aba0be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.598041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822e5d1-f0b1-4483-a85d-12e50e7578c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.598653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822e5d1-f0b1-4483-a85d-12e50e7578c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.598927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822e5d1-f0b1-4483-a85d-12e50e7578c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.599189 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822e5d1-f0b1-4483-a85d-12e50e7578c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.599849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822e5d1-f0b1-4483-a85d-12e50e7578c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.600994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-7822e5d1-f0b1-4483-a85d-12e50e7578c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:02:27.600994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: warnings.warn(msg) Aug 30 01:02:27.600994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: Aug 30 01:02:27.602184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822e5d1-f0b1-4483-a85d-12e50e7578c1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.604554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a2f7f049-ac20-4bcd-9112-e7139aba0be7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.605791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a2f7f049-ac20-4bcd-9112-e7139aba0be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.615123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 773/1549] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.616639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0b6cc-407a-42bd-80a8-5a1c82326da0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.617039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0b6cc-407a-42bd-80a8-5a1c82326da0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.617431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0b6cc-407a-42bd-80a8-5a1c82326da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.628988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 777/1550] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:02:27.630296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25102e-9c01-421e-a791-3e3d5a1a5746 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.630599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25102e-9c01-421e-a791-3e3d5a1a5746 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.630865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25102e-9c01-421e-a791-3e3d5a1a5746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.638186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-21f0b6cc-407a-42bd-80a8-5a1c82326da0 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.639382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-21f0b6cc-407a-42bd-80a8-5a1c82326da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.647631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 774/1551] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.648919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64596f-7552-466f-9515-1f522eae2c6f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.649201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64596f-7552-466f-9515-1f522eae2c6f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.649470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64596f-7552-466f-9515-1f522eae2c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.651189 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c25102e-9c01-421e-a791-3e3d5a1a5746 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.652560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c25102e-9c01-421e-a791-3e3d5a1a5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.660772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 778/1552] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.661838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25102e-9c01-421e-a791-3e3d5a1a5746 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.672154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25102e-9c01-421e-a791-3e3d5a1a5746 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.675381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ed64596f-7552-466f-9515-1f522eae2c6f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.676616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ed64596f-7552-466f-9515-1f522eae2c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.676725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab6d98-d559-4a13-8982-9d51a9d60591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.677336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6d98-d559-4a13-8982-9d51a9d60591 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.677610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6d98-d559-4a13-8982-9d51a9d60591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.677872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab6d98-d559-4a13-8982-9d51a9d60591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.678512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6d98-d559-4a13-8982-9d51a9d60591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.680152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab6d98-d559-4a13-8982-9d51a9d60591 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.685840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 775/1553] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.687205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92046dc-88d6-4ff3-bf6e-bf8229209a40 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.687584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92046dc-88d6-4ff3-bf6e-bf8229209a40 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.687968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92046dc-88d6-4ff3-bf6e-bf8229209a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.691424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 779/1554] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:27.692794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f67b-9bc0-4ff2-bb3a-d8617b1a2903 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.693217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f67b-9bc0-4ff2-bb3a-d8617b1a2903 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.693721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8f67b-9bc0-4ff2-bb3a-d8617b1a2903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.709216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b92046dc-88d6-4ff3-bf6e-bf8229209a40 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.710482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b92046dc-88d6-4ff3-bf6e-bf8229209a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.714072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1bc8f67b-9bc0-4ff2-bb3a-d8617b1a2903 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.715223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1bc8f67b-9bc0-4ff2-bb3a-d8617b1a2903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.719062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 776/1555] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.721051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5065c-76bb-4d74-ab60-2af14ffa1268 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.721051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5065c-76bb-4d74-ab60-2af14ffa1268 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.721051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5065c-76bb-4d74-ab60-2af14ffa1268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.728560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 780/1556] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.729432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8f67b-9bc0-4ff2-bb3a-d8617b1a2903 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.739935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8f67b-9bc0-4ff2-bb3a-d8617b1a2903 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.744416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d69336-e2df-4323-befd-20411f9117f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.745069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d69336-e2df-4323-befd-20411f9117f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.745339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d69336-e2df-4323-befd-20411f9117f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.745605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d69336-e2df-4323-befd-20411f9117f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.745777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-86c5065c-76bb-4d74-ab60-2af14ffa1268 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.746382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d69336-e2df-4323-befd-20411f9117f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.747000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-86c5065c-76bb-4d74-ab60-2af14ffa1268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.748003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d69336-e2df-4323-befd-20411f9117f1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.755696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 777/1557] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.756929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc539-14b0-4417-9238-2460633ce821 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.757213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc539-14b0-4417-9238-2460633ce821 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.757536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc539-14b0-4417-9238-2460633ce821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.761406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 781/1558] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:27.761406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d57c-6811-44c1-b54b-ad408330aa46 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.761406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d57c-6811-44c1-b54b-ad408330aa46 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.761406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311d57c-6811-44c1-b54b-ad408330aa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.777761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-edfdc539-14b0-4417-9238-2460633ce821 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.778986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-edfdc539-14b0-4417-9238-2460633ce821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.779703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b311d57c-6811-44c1-b54b-ad408330aa46 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.781277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b311d57c-6811-44c1-b54b-ad408330aa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.787359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 778/1559] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.789108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 782/1560] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.790213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278d3de-494c-482d-8bb7-33573be3c60b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.790488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278d3de-494c-482d-8bb7-33573be3c60b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.790757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278d3de-494c-482d-8bb7-33573be3c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.794467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdc539-14b0-4417-9238-2460633ce821 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.805980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdc539-14b0-4417-9238-2460633ce821 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.810449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0278d3de-494c-482d-8bb7-33573be3c60b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.810944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779aa36-44a1-4e5d-9adc-c1dec154592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.811648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779aa36-44a1-4e5d-9adc-c1dec154592a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.811771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0278d3de-494c-482d-8bb7-33573be3c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.811929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779aa36-44a1-4e5d-9adc-c1dec154592a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.812285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779aa36-44a1-4e5d-9adc-c1dec154592a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.812992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779aa36-44a1-4e5d-9adc-c1dec154592a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.814610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779aa36-44a1-4e5d-9adc-c1dec154592a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.819358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 783/1561] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.820512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9275a0-bdc0-4a37-bfe6-ca8c729ba1a7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.820794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9275a0-bdc0-4a37-bfe6-ca8c729ba1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.821086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9275a0-bdc0-4a37-bfe6-ca8c729ba1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.825917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 779/1562] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:27.827476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dfabe-688f-46a3-a7a0-54ada17b1899 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.827718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dfabe-688f-46a3-a7a0-54ada17b1899 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.827991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dfabe-688f-46a3-a7a0-54ada17b1899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.829537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:27.841915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ef9275a0-bdc0-4a37-bfe6-ca8c729ba1a7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.843688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef9275a0-bdc0-4a37-bfe6-ca8c729ba1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.847728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-967dfabe-688f-46a3-a7a0-54ada17b1899 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:27.849010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-967dfabe-688f-46a3-a7a0-54ada17b1899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:27.851499 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 784/1563] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.852271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9275a0-bdc0-4a37-bfe6-ca8c729ba1a7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.861431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 780/1564] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:27.865563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9275a0-bdc0-4a37-bfe6-ca8c729ba1a7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.865666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967dfabe-688f-46a3-a7a0-54ada17b1899 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.867072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.867674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.867945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.868232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.868942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:27.869208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.870244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:02:27.870244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: warnings.warn(msg) Aug 30 01:02:27.870244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: Aug 30 01:02:27.871110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.876828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967dfabe-688f-46a3-a7a0-54ada17b1899 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.882157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.882781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.883057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.883326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.883427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 785/1565] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:27.883979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.884176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.885720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.893796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edf4b-343b-4dc2-b274-e77337f629b9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.896875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 781/1566] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:27.897578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.898715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.899319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.899600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.900067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.900722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:27.901061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.902811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.907394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2286e-4da1-4f15-8ab9-e4b8602377d7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.912110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.912734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.913039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.913312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.913944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:27.914239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.915657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 786/1567] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:27.915783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.916473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.926968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f83c4-f755-404b-a60d-e1ce16e0aa4d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.929348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 782/1568] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:27.930146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.931763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.932367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.932642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.932940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.933580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:27.933877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.935471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.940406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290dcec-3caf-4086-a572-0fb570f4e28c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.945261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.945927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.946207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.946473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] PATH_INFO: `/v3/projects/0dedcbca857942808845fb7039a16aaf/users/f077b9f8c63d4b75bf5290d32de393d7/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.954836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 787/1569] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:27.954836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.955110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:27.963203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dedcbca857942808845fb7039a16aaf, user_id=f077b9f8c63d4b75bf5290d32de393d7, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.964256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:02:27.964256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 01:02:27.964256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 01:02:27.964878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8727e7-2ea9-4ee8-9f7d-9d1e051aa92d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:27.966237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.969745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:27.970408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:27.970721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:27.970942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:27.971587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:27.971976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:27.973666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:27.980502 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 783/1570] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:27 2022] PUT /identity/v3/projects/0dedcbca857942808845fb7039a16aaf/users/f077b9f8c63d4b75bf5290d32de393d7/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:27.981551 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.986458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 788/1571] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:27.987184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:27.996920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7fe9-53c0-4677-9d48-837af8b9857c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.049807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686cad-5982-42b8-976a-7b1976c15553 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.054230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.054682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.054845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.054946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.055117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.055228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.055382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.055486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.056023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:28.056138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.056320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.057931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.058119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.072858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 784/1572] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:28.074040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.084701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685976b-7cd4-4dd7-b411-8d5ec55963ce admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.091135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 789/1573] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:27 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.091135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.092218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.092978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.093461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.093647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] PATH_INFO: `/v3/projects/3204782516844498a28d5eac446ab72d/users/df31a323d2b245d9afdcfe4eb1e64b7e/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.108860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3204782516844498a28d5eac446ab72d, user_id=df31a323d2b245d9afdcfe4eb1e64b7e, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.111849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.126954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 785/1574] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:28 2022] PUT /identity/v3/projects/3204782516844498a28d5eac446ab72d/users/df31a323d2b245d9afdcfe4eb1e64b7e/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:28.127730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.153476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3c00c-98bf-456e-a368-4b36d7436f20 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.187271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:28.195470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86b2f-92a1-4820-aa67-040c702133b9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.200475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.201123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.201406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.201681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.202315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.204309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.212434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46df488-7653-4a5a-86a0-765cad672211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.213062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46df488-7653-4a5a-86a0-765cad672211 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.213339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46df488-7653-4a5a-86a0-765cad672211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.214047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46df488-7653-4a5a-86a0-765cad672211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.214684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46df488-7653-4a5a-86a0-765cad672211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.217020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46df488-7653-4a5a-86a0-765cad672211 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.234970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 786/1575] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.236391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.253624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 790/1576] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.255008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711dd77-ec57-43e2-9f02-27a11698fadd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.255292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711dd77-ec57-43e2-9f02-27a11698fadd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.255561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711dd77-ec57-43e2-9f02-27a11698fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.273978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a711dd77-ec57-43e2-9f02-27a11698fadd None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:28.275177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a711dd77-ec57-43e2-9f02-27a11698fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:28.281641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:28.304789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46cf86-4b34-4e61-bb08-992705c0812d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.336213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 791/1577] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:28.337052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711dd77-ec57-43e2-9f02-27a11698fadd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.346484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711dd77-ec57-43e2-9f02-27a11698fadd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.351349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.351948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.352217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.352479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.353152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.355074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.363846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.364471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.364751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.365081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.365743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.367633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.383530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 792/1578] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.384187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.397360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 787/1579] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.398192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.458952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca75a1-c78e-46df-87f7-529de459f84b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.468536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928420f-313b-4395-b74f-3e46ad83b737 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.473967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54a64-cc54-476e-906e-1553f615a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.474622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54a64-cc54-476e-906e-1553f615a89a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.474919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54a64-cc54-476e-906e-1553f615a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.475186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54a64-cc54-476e-906e-1553f615a89a admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.475807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a54a64-cc54-476e-906e-1553f615a89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.477763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a54a64-cc54-476e-906e-1553f615a89a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.500129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 788/1580] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.501418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dced-d9e0-4dfc-aa8c-7670db261667 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.501710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dced-d9e0-4dfc-aa8c-7670db261667 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.502007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dced-d9e0-4dfc-aa8c-7670db261667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.508503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:28.523813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.524426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.524702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.525082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.525721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.527639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.530411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0d59dced-d9e0-4dfc-aa8c-7670db261667 None None] MFA Rules not processed for user `df31a323d2b245d9afdcfe4eb1e64b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:28.531600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0d59dced-d9e0-4dfc-aa8c-7670db261667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:28.557182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 793/1581] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.557910 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.582497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:28.602316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 789/1582] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:28.603136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dced-d9e0-4dfc-aa8c-7670db261667 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.614069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dced-d9e0-4dfc-aa8c-7670db261667 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.626166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95cba-aaeb-4d28-9667-c0f61ef344d2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.630991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.631599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.631875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.632143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.632771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.634728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.656933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 794/1583] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.657761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.674869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.675484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.675766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.676034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.676659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.678597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.703571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 790/1584] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.703571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.711837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411718ca-1c33-41eb-89b5-6d972573f519 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.716651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.717277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.717600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.717959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.718631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.719219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2bf3-a74e-4910-ad4a-12038e5b08df admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.720621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.722874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.723479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.723755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.724046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.733973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.735849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.752538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 791/1585] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.754087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.756711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 795/1586] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:28.757748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.770726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee866f9-91f4-412d-b179-f8cba8a043d5 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.774326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacef7b-c747-48e5-b765-4334f578cb8a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.775701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.776347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.776633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.776922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.777589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.779244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.782977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.783634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.784162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.784441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.786427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.788793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.791038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 796/1587] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:28.791858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.803921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bad8c-4772-41e1-93b9-8f495b2c2502 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.809421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.809974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.810248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.810515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.811136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.813334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.816065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 792/1588] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.816744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.830992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f249b57-4e5e-4e45-bfae-515ccd3f4aee admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.836639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.837356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.837882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.838278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.838914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.840899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.841885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 797/1589] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/users => generated 282 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.842857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.854369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5863641-e846-425d-9206-b5ddeeed6ee5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.859268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.859973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.860464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.860722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.861646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.863712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.876046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 798/1590] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:28.877109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 793/1591] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:28 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:28.878170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.881073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.892338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9b7e6-9501-4007-b286-129d1e67c8be admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.919175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:28.965784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdeec9-6816-4cef-bdc2-9de6c9f084c9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:28.968067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.968688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.969032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.969298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.969941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.970709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:28.971319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:28.971594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:28.971710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.971859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:28.972509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:28.974115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:28.986699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 794/1592] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:28.988058 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:28.990247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 799/1593] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:28.991221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.000713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044fedb-d006-4b08-9a0d-3406b123f5d8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.001099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a25cb-092b-4a4c-818e-5dadec1c2fea admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.005300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.005606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.005905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.006179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.006288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.006469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.006575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.006731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.007099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.007332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.008794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.008925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.022548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 795/1594] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.023857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 800/1595] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.024767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.026347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.037949 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825309f-d332-44dc-9d6c-76a6e940d28b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.039676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76ba2-0fd2-4f75-b33d-f9fd2b002c72 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.043723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.044380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.044656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.044953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.045584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.045861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.046925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.047290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.047652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.048130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.048491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.050250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.051965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:29.065250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 796/1596] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.065599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.078093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3f72-e7b0-446b-a3d0-d448b95b025b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.078636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 801/1597] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:29 2022] POST /identity/v3/users => generated 296 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:29.080258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.085665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.089543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.089543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.089543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.089543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.090015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.090484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469b556-4870-423f-94f0-7457a8fc0bc9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.097290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.098047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.098318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.098626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.099264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.101269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.108889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 797/1598] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.110637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.118019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 802/1599] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.119144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.130040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9d5b7-ae74-4115-b78c-46aa5cd4f91f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.131605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89f60f-88b9-4895-8868-fce6712b9a00 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.136424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.137142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.137255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.137440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.137685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.137939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.138271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.138375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.138537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.139167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.140107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.141124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.152522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 798/1600] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.153429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.161164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 803/1601] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.162258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.166043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c18e-3062-48aa-bbc2-2cc68f11d793 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.172268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.172984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.173259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.173545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] PATH_INFO: `/v3/projects/95425d9bc2cd491eb337f88c5bb8095c/users/b6b474e9ef2e49b3a27b73d8ffd385b1/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.175406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91f120-22c6-401b-9984-0e95c9899287 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.185270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.185913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.186229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.187066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.187722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.189592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.193763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95425d9bc2cd491eb337f88c5bb8095c, user_id=b6b474e9ef2e49b3a27b73d8ffd385b1, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.197221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.204862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 804/1602] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.204862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.213424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716bb3-a855-44d5-90e6-00942b2799bf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.219253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 799/1603] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:29 2022] PUT /identity/v3/projects/95425d9bc2cd491eb337f88c5bb8095c/users/b6b474e9ef2e49b3a27b73d8ffd385b1/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:29.220439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.289558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.290315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.290523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.290792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.291634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.293115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86892be3-3113-426f-b45f-0687fbdc2374 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.293347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.298702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.299881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.299881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.300098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] PATH_INFO: `/v3/projects/4cbcce7c24da4903be78df680ac5691e/users/18bbd262271f4323acad6669d629f9f4/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.305280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 805/1604] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:29.306124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.316396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbcce7c24da4903be78df680ac5691e, user_id=18bbd262271f4323acad6669d629f9f4, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.317710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cb0e8-4c15-4495-81a8-bcea6e802df6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.319230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.323733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.324541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.324779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.325073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] PATH_INFO: `/v3/projects/98a86c7c9ea1414abfa71ac7e3f03ed4/users/e2b354bfe62742e3bce1b8ec7eb85e50/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.340584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 800/1605] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:29 2022] PUT /identity/v3/projects/4cbcce7c24da4903be78df680ac5691e/users/18bbd262271f4323acad6669d629f9f4/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:29.341633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.345766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a86c7c9ea1414abfa71ac7e3f03ed4, user_id=e2b354bfe62742e3bce1b8ec7eb85e50, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.348706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.365568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 806/1606] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:29 2022] PUT /identity/v3/projects/98a86c7c9ea1414abfa71ac7e3f03ed4/users/e2b354bfe62742e3bce1b8ec7eb85e50/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:29.366458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.418079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:29.447130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671397c4-4c4a-46e4-a646-d0c506ca052c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.452568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.453374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.453826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.454000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] PATH_INFO: `/v3/projects/84c90381a5254271a782e50df047fbc5/users/40ed6647aea94ff9b717b79a34faa3e7/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.455088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7848d97-e1b0-42f2-ae8b-cc97f541f2ba admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.460362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4863d7-feb5-4180-a6ed-248835383176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.461155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4863d7-feb5-4180-a6ed-248835383176 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.461311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4863d7-feb5-4180-a6ed-248835383176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.461706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4863d7-feb5-4180-a6ed-248835383176 admin admin] PATH_INFO: `/v3/projects/65c70c0408944145bf2c502a23032f9b/users/ec329f81679e4ffa83174d621b4440d4/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.473300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c90381a5254271a782e50df047fbc5, user_id=40ed6647aea94ff9b717b79a34faa3e7, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.477774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.478823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4863d7-feb5-4180-a6ed-248835383176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c70c0408944145bf2c502a23032f9b, user_id=ec329f81679e4ffa83174d621b4440d4, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.481497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4863d7-feb5-4180-a6ed-248835383176 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.496217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 801/1607] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:29 2022] PUT /identity/v3/projects/84c90381a5254271a782e50df047fbc5/users/40ed6647aea94ff9b717b79a34faa3e7/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:29.497569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.506040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 807/1608] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:29 2022] PUT /identity/v3/projects/65c70c0408944145bf2c502a23032f9b/users/ec329f81679e4ffa83174d621b4440d4/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:29.508277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7efda2-e0b9-4d9e-8963-fe5485bc88b7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.508574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7efda2-e0b9-4d9e-8963-fe5485bc88b7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.508858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7efda2-e0b9-4d9e-8963-fe5485bc88b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.523479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:29.533113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6f7efda2-e0b9-4d9e-8963-fe5485bc88b7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:29.534556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6f7efda2-e0b9-4d9e-8963-fe5485bc88b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:29.588339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d288-7eba-485d-a77c-4eb800b94503 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.609216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 808/1609] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:29.610443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7efda2-e0b9-4d9e-8963-fe5485bc88b7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.621752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7efda2-e0b9-4d9e-8963-fe5485bc88b7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.627330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb1d75-47dd-4867-bc42-873cb5abd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.628006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1d75-47dd-4867-bc42-873cb5abd0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.628264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1d75-47dd-4867-bc42-873cb5abd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.628532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1d75-47dd-4867-bc42-873cb5abd0a4 admin admin] PATH_INFO: `/v3/projects/591854270f534bfcbb56f97b0738d286/users/84a87a794ca645cf815a6e2e8a3da4ab/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.654157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb1d75-47dd-4867-bc42-873cb5abd0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591854270f534bfcbb56f97b0738d286, user_id=84a87a794ca645cf815a6e2e8a3da4ab, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.658380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb1d75-47dd-4867-bc42-873cb5abd0a4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.677482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0546e7-0695-4f00-a912-9e21a5322050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.678150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0546e7-0695-4f00-a912-9e21a5322050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.678425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0546e7-0695-4f00-a912-9e21a5322050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.678696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0546e7-0695-4f00-a912-9e21a5322050 admin admin] PATH_INFO: `/v3/projects/e1c5dd8afd5c4a9a9788049bafc872d2/users/ad7dfb839b50422783afacf9bab3b64a/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.681482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 809/1610] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:29 2022] PUT /identity/v3/projects/591854270f534bfcbb56f97b0738d286/users/84a87a794ca645cf815a6e2e8a3da4ab/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:29.684444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce99a36-07ad-4a02-a595-386420404cbb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.685678 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce99a36-07ad-4a02-a595-386420404cbb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.686169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce99a36-07ad-4a02-a595-386420404cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.707359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0546e7-0695-4f00-a912-9e21a5322050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c5dd8afd5c4a9a9788049bafc872d2, user_id=ad7dfb839b50422783afacf9bab3b64a, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.711026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5ce99a36-07ad-4a02-a595-386420404cbb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:29.711784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0546e7-0695-4f00-a912-9e21a5322050 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:29.712513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5ce99a36-07ad-4a02-a595-386420404cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:29.733585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 802/1611] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:29 2022] PUT /identity/v3/projects/e1c5dd8afd5c4a9a9788049bafc872d2/users/ad7dfb839b50422783afacf9bab3b64a/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:29.735342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f39e4b-5761-4332-a62a-63e97a03c31b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.735663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f39e4b-5761-4332-a62a-63e97a03c31b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.735980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f39e4b-5761-4332-a62a-63e97a03c31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.772627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-57f39e4b-5761-4332-a62a-63e97a03c31b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:29.774654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-57f39e4b-5761-4332-a62a-63e97a03c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:29.809753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 810/1612] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:29.809753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7235c6-7d5f-4301-b30e-5471a8226e0d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.809753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7235c6-7d5f-4301-b30e-5471a8226e0d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.809753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7235c6-7d5f-4301-b30e-5471a8226e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.846731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2d7235c6-7d5f-4301-b30e-5471a8226e0d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:29.848861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d7235c6-7d5f-4301-b30e-5471a8226e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:29.857891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 803/1613] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:29.859754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.860599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.861096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.883318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:29.885145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:29.894796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 804/1614] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:29.896214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.897818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:29.927292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:29.961170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:29.967408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 811/1615] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:29.969743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7235c6-7d5f-4301-b30e-5471a8226e0d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:29.981455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7235c6-7d5f-4301-b30e-5471a8226e0d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.987031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841604-0c3f-4afb-9bf3-11ac7b7442be None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:29.988107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20662-df0b-4a9c-87f3-3bb649b4a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.988982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20662-df0b-4a9c-87f3-3bb649b4a81e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.989550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20662-df0b-4a9c-87f3-3bb649b4a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.990023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20662-df0b-4a9c-87f3-3bb649b4a81e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.990938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20662-df0b-4a9c-87f3-3bb649b4a81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:29.991707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:29.992388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:29.992786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:29.993184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:29.993807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20662-df0b-4a9c-87f3-3bb649b4a81e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.005791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.007596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.008913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 812/1616] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:30.010207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887af26-4fd8-4132-a475-4f48b17ad18c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.010558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887af26-4fd8-4132-a475-4f48b17ad18c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.010746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887af26-4fd8-4132-a475-4f48b17ad18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.042320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 805/1617] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:30.044406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.046056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5887af26-4fd8-4132-a475-4f48b17ad18c None None] MFA Rules not processed for user `ad7dfb839b50422783afacf9bab3b64a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:30.049063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5887af26-4fd8-4132-a475-4f48b17ad18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:30.069234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7392-9f00-4028-9040-d42953177c9b service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.079754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.081613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.082342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.083435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.111549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.116056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.135147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 806/1618] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:30.136060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.145845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6506c-b3cf-4d98-ae0d-d40575fd13a5 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.148034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 813/1619] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:30.151923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887af26-4fd8-4132-a475-4f48b17ad18c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.152136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.152136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.152136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.152136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.165602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.167739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.174313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887af26-4fd8-4132-a475-4f48b17ad18c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.178407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.179078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.179493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.179771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.182066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 807/1620] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:30.183274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.192674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.193449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fa4d8-30af-4efb-90ea-c2a0a0974de6 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.194350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.197475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.198398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.198741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.199189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.210487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 814/1621] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:30.211293 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.211429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.212972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.226351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2b2a-ec32-434b-a6b9-38f7f00663f0 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.227146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 808/1622] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:30.228119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.240460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4471a-e87c-45f9-bc13-0c7c10e64b65 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.242823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2747e4-e3a9-4f83-bd0c-3d6ff6bdced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.244541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2747e4-e3a9-4f83-bd0c-3d6ff6bdced8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.244841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2747e4-e3a9-4f83-bd0c-3d6ff6bdced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.246253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2747e4-e3a9-4f83-bd0c-3d6ff6bdced8 admin admin] PATH_INFO: `/v3/projects/591854270f534bfcbb56f97b0738d286/users/84a87a794ca645cf815a6e2e8a3da4ab/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.251543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2747e4-e3a9-4f83-bd0c-3d6ff6bdced8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591854270f534bfcbb56f97b0738d286, user_id=84a87a794ca645cf815a6e2e8a3da4ab, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.254365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.255109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.255385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.255649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.256284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.260573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2747e4-e3a9-4f83-bd0c-3d6ff6bdced8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.262436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.286621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 815/1623] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:30 2022] PUT /identity/v3/projects/591854270f534bfcbb56f97b0738d286/users/84a87a794ca645cf815a6e2e8a3da4ab/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:30.305355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55e1a-c758-4ee8-9b93-b0fbb60ddb86 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.305617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55e1a-c758-4ee8-9b93-b0fbb60ddb86 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.306016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b55e1a-c758-4ee8-9b93-b0fbb60ddb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.336041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 809/1624] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:30 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:30.340125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.370837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e2b55e1a-c758-4ee8-9b93-b0fbb60ddb86 None None] MFA Rules not processed for user `84a87a794ca645cf815a6e2e8a3da4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:30.372499 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2b55e1a-c758-4ee8-9b93-b0fbb60ddb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:30.489122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3adb9-d064-45f0-9a7f-eece9b4686e2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.496260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.496934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.497215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.497487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.499099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.500823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.512531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 816/1625] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:30.603142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b55e1a-c758-4ee8-9b93-b0fbb60ddb86 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.604125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 810/1626] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:30 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:02:30.604125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.604630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:30.604729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f01db-296e-4710-9dc8-55555df73764 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.604729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.604729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.604729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.605160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.605160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.606248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.635828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 811/1627] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:30.644113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.667943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436f7ce-f522-4554-83cc-955af622b6df admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.672021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b55e1a-c758-4ee8-9b93-b0fbb60ddb86 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.680562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.681288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.681574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.681852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] PATH_INFO: `/v3/projects/4b146360d4b340c79a089ea269bae791/users/1b2ac994ca634ddbaa33fb36a9bb561b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.683371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25de62-7f92-41c3-9148-e6fab986ccc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.683938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25de62-7f92-41c3-9148-e6fab986ccc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.684218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25de62-7f92-41c3-9148-e6fab986ccc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.684503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25de62-7f92-41c3-9148-e6fab986ccc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.723414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b146360d4b340c79a089ea269bae791, user_id=1b2ac994ca634ddbaa33fb36a9bb561b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.727473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.750164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 812/1628] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:30 2022] PUT /identity/v3/projects/4b146360d4b340c79a089ea269bae791/users/1b2ac994ca634ddbaa33fb36a9bb561b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:30.752719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.819283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:30.854259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fc25-21a9-4d83-b42d-244ead47276b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.862747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.864030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.864314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.864594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.865931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.867412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.870879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25de62-7f92-41c3-9148-e6fab986ccc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.872687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25de62-7f92-41c3-9148-e6fab986ccc8 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.884480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 813/1629] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:30.885529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:30.897497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0a618-6cff-4df3-b9c9-f7d4f7226144 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:30.904538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37989265-24da-4248-8c23-264816c2540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:30.905605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989265-24da-4248-8c23-264816c2540d admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.905975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989265-24da-4248-8c23-264816c2540d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.906307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989265-24da-4248-8c23-264816c2540d admin admin] PATH_INFO: `/v3/projects/4b146360d4b340c79a089ea269bae791/users/1b2ac994ca634ddbaa33fb36a9bb561b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:30.909933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37989265-24da-4248-8c23-264816c2540d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b146360d4b340c79a089ea269bae791, user_id=1b2ac994ca634ddbaa33fb36a9bb561b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:30.911688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37989265-24da-4248-8c23-264816c2540d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:30.912818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 817/1630] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:02:30.953289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 814/1631] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:30 2022] PUT /identity/v3/projects/4b146360d4b340c79a089ea269bae791/users/1b2ac994ca634ddbaa33fb36a9bb561b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:30.963545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06053f2-c62e-4c6e-ad1e-477ba4e6c5ae None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:30.963921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06053f2-c62e-4c6e-ad1e-477ba4e6c5ae None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:30.964082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06053f2-c62e-4c6e-ad1e-477ba4e6c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:31.005990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f06053f2-c62e-4c6e-ad1e-477ba4e6c5ae None None] MFA Rules not processed for user `1b2ac994ca634ddbaa33fb36a9bb561b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:31.007279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f06053f2-c62e-4c6e-ad1e-477ba4e6c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:31.120503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 818/1632] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:31.138180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37989265-24da-4248-8c23-264816c2540d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:31.260725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37989265-24da-4248-8c23-264816c2540d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:31.271348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3397-09ae-4a73-9900-02e5558f404a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:31.272096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3397-09ae-4a73-9900-02e5558f404a service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:31.272376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3397-09ae-4a73-9900-02e5558f404a service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:31.273639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3397-09ae-4a73-9900-02e5558f404a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:31.309560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3397-09ae-4a73-9900-02e5558f404a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:31.311144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3397-09ae-4a73-9900-02e5558f404a service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:31.341651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 815/1633] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:31.534354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06053f2-c62e-4c6e-ad1e-477ba4e6c5ae None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:31.549419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06053f2-c62e-4c6e-ad1e-477ba4e6c5ae None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:31.553833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:31.554670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:31.554816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:31.555094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:31.648515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:31.689537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:31.692417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:31.704990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 819/1634] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:33.192371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490061-43eb-4f64-bdc7-049f786b4ee9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:33.193352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490061-43eb-4f64-bdc7-049f786b4ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:33.193811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490061-43eb-4f64-bdc7-049f786b4ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:33.279507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:33.289734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-56490061-43eb-4f64-bdc7-049f786b4ee9 None None] MFA Rules not processed for user `18bbd262271f4323acad6669d629f9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:33.292002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28328-cfab-4c4b-84d7-6dc2c8a5dea2 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:33.294842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-56490061-43eb-4f64-bdc7-049f786b4ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:33.300305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:33.301158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:33.301577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:33.302625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:33.452708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:33.453863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 816/1635] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:33.455827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:33.459834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56490061-43eb-4f64-bdc7-049f786b4ee9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:33.497608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 820/1636] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:02:33.595250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:33.632054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56490061-43eb-4f64-bdc7-049f786b4ee9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:33.645625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:33.646550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:33.650171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:33.650687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:33.652112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:33.658828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:33.721545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 817/1637] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:33 2022] POST /identity/v3/projects => generated 403 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:02:33.725581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:33.742269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf2718-0e1f-4e47-a82d-a0cfda90746d service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:33.871944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:33.874049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:33.874884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:33.875181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:33.877748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:33.888504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:33.943815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 821/1638] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:33 2022] POST /identity/v3/users => generated 308 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:02:33.962267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:33.984190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0054fa3-518a-48b5-933d-f981c064e7b5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:33.994896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:33.995875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:33.996220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:33.996555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:33.997321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:33.999515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:34.046490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 818/1639] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:34.048038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:34.059319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c2a6-c5a8-484c-95ca-3fefe9a05ef7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:34.070250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:34.071264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:34.071772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:34.072376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] PATH_INFO: `/v3/projects/d4a3ef88033a45c5a4cfdfec87ab5bb5/users/2941f514b2a24a1ba28f696bfbcd7c8f/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:34.101897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a3ef88033a45c5a4cfdfec87ab5bb5, user_id=2941f514b2a24a1ba28f696bfbcd7c8f, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:34.106969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:34.138214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 822/1640] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:34 2022] PUT /identity/v3/projects/d4a3ef88033a45c5a4cfdfec87ab5bb5/users/2941f514b2a24a1ba28f696bfbcd7c8f/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:34.142296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:34.163253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbaaaa-cccc-4057-a006-39ebe8e2dd58 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:34.301482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:34.303158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:34.304671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:34.305143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:34.306885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:34.312076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:34.342033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 819/1641] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:02:34.346470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:34.360329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec1af7-6ac2-41b5-8890-a859cce3ad03 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:34.367214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fca9f-efbb-438e-8462-0f2d11d12cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:34.368337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fca9f-efbb-438e-8462-0f2d11d12cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:34.369424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fca9f-efbb-438e-8462-0f2d11d12cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:34.369911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fca9f-efbb-438e-8462-0f2d11d12cde admin admin] PATH_INFO: `/v3/projects/d4a3ef88033a45c5a4cfdfec87ab5bb5/users/2941f514b2a24a1ba28f696bfbcd7c8f/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:34.373024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fca9f-efbb-438e-8462-0f2d11d12cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a3ef88033a45c5a4cfdfec87ab5bb5, user_id=2941f514b2a24a1ba28f696bfbcd7c8f, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:34.376415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fca9f-efbb-438e-8462-0f2d11d12cde admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:34.402950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 823/1642] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:34 2022] PUT /identity/v3/projects/d4a3ef88033a45c5a4cfdfec87ab5bb5/users/2941f514b2a24a1ba28f696bfbcd7c8f/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:35.718306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:35.731425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c420d-4490-4536-ae55-cbe0cb26f270 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:35.884132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:35.885584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:35.886040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:35.886479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] PATH_INFO: `/v3/users/ad7dfb839b50422783afacf9bab3b64a` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:35.890655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7dfb839b50422783afacf9bab3b64a)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:35.893415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:02:35.893415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: warnings.warn(msg) Aug 30 01:02:35.893415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: Aug 30 01:02:35.896717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:36.044297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7dfb839b50422783afacf9bab3b64a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:36.106224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7dfb839b50422783afacf9bab3b64a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:36.127385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7dfb839b50422783afacf9bab3b64a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:36.127931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7dfb839b50422783afacf9bab3b64a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:36.129629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:36.162097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a10d3d8-3969-48f9-81c5-d2e9b5a4cd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7dfb839b50422783afacf9bab3b64a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:36.172052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 820/1643] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:35 2022] DELETE /identity/v3/users/ad7dfb839b50422783afacf9bab3b64a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:02:36.177031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:36.177636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:36.177636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:36.219889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:36.221917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:36.238603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:36.238935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:36.239185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:36.275155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:36.303160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] MFA Rules not processed for user `2941f514b2a24a1ba28f696bfbcd7c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:36.304617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:36.354387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 824/1644] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:36.368053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:36.370613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:36.505797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 821/1645] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:36.535546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a6af-101d-496f-8471-26593d82f9f2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:36.546798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fd6b1-1007-4659-867e-4346ef872a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:36.547681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fd6b1-1007-4659-867e-4346ef872a87 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:36.547782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fd6b1-1007-4659-867e-4346ef872a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:36.547976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fd6b1-1007-4659-867e-4346ef872a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:36.566399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fd6b1-1007-4659-867e-4346ef872a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:36.568847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fd6b1-1007-4659-867e-4346ef872a87 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:36.598320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 825/1646] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:38.370774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:38.372255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:38.387684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b039f-672d-440a-b7b3-50b6c3cc06c4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:38.418384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:38.419781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:38.420279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:38.422048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] PATH_INFO: `/v3/users/df31a323d2b245d9afdcfe4eb1e64b7e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:38.426869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df31a323d2b245d9afdcfe4eb1e64b7e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:38.430340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:38.554990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df31a323d2b245d9afdcfe4eb1e64b7e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:38.580339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df31a323d2b245d9afdcfe4eb1e64b7e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:38.609143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df31a323d2b245d9afdcfe4eb1e64b7e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:38.610248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df31a323d2b245d9afdcfe4eb1e64b7e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:38.639133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a62825eb-3943-4bd6-9f62-151bf8ec8118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df31a323d2b245d9afdcfe4eb1e64b7e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:38.653246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 822/1647] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:38 2022] DELETE /identity/v3/users/df31a323d2b245d9afdcfe4eb1e64b7e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:38.658285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274376-a807-4091-ad41-b18739ee820d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:38.658846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274376-a807-4091-ad41-b18739ee820d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:38.658846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274376-a807-4091-ad41-b18739ee820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:38.733157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-00274376-a807-4091-ad41-b18739ee820d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:38.734596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-00274376-a807-4091-ad41-b18739ee820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:38.917277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d15f4-d3a2-4051-897c-6ef9ae5446bb None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:38.917901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d15f4-d3a2-4051-897c-6ef9ae5446bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:38.918377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d15f4-d3a2-4051-897c-6ef9ae5446bb None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:38.919993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 823/1648] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:02:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:38.978952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 826/1649] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:39.191559 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992fd5-b62f-4607-937b-6d2ed39a93d8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:39.199999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992fd5-b62f-4607-937b-6d2ed39a93d8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:39.200493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992fd5-b62f-4607-937b-6d2ed39a93d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:39.276279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ce992fd5-b62f-4607-937b-6d2ed39a93d8 None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:39.281994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ce992fd5-b62f-4607-937b-6d2ed39a93d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:39.309311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274376-a807-4091-ad41-b18739ee820d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:39.311896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-00274376-a807-4091-ad41-b18739ee820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:39.441863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:39.546379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274376-a807-4091-ad41-b18739ee820d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:39.561577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:39.562460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:39.562875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:39.563257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:39.586880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:39.589830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:39.592344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 824/1650] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:39.593753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24118-1773-4b86-b988-8b362fb534f6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:39.594029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24118-1773-4b86-b988-8b362fb534f6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:39.598127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24118-1773-4b86-b988-8b362fb534f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:39.624473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 827/1651] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:02:39.708542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-50a24118-1773-4b86-b988-8b362fb534f6 None None] MFA Rules not processed for user `f077b9f8c63d4b75bf5290d32de393d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:39.710092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-50a24118-1773-4b86-b988-8b362fb534f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:39.763358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:39.766054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:39.802873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee7a97-8603-4e8e-b683-e4ab2d388a73 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:39.832518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bf49e-2a1b-43e2-af10-fe6452ae2429 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:39.833632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bf49e-2a1b-43e2-af10-fe6452ae2429 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:39.838330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bf49e-2a1b-43e2-af10-fe6452ae2429 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:39.838909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bf49e-2a1b-43e2-af10-fe6452ae2429 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:39.867047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bf49e-2a1b-43e2-af10-fe6452ae2429 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:39.899257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bf49e-2a1b-43e2-af10-fe6452ae2429 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:39.908143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 825/1652] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:39.912162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f60c8a-ebf0-4784-aaed-a28d3a39ba87 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:39.913452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f60c8a-ebf0-4784-aaed-a28d3a39ba87 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:39.913758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f60c8a-ebf0-4784-aaed-a28d3a39ba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:39.933088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 828/1653] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:02:39.991936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-80f60c8a-ebf0-4784-aaed-a28d3a39ba87 None None] MFA Rules not processed for user `f077b9f8c63d4b75bf5290d32de393d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:39.995689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-80f60c8a-ebf0-4784-aaed-a28d3a39ba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:40.015572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 826/1654] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:40.061297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9948fc-36ce-4eca-abf9-6bb3a0acbb6e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:40.061907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9948fc-36ce-4eca-abf9-6bb3a0acbb6e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:40.062385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9948fc-36ce-4eca-abf9-6bb3a0acbb6e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:40.065775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 829/1655] 10.222.0.89 () {54 vars in 962 bytes} [Tue Aug 30 01:02:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:40.078232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6330c7-62e4-4ec2-bb1e-5f56425d40b7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:40.078571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6330c7-62e4-4ec2-bb1e-5f56425d40b7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:40.079337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6330c7-62e4-4ec2-bb1e-5f56425d40b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:40.192934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0e6330c7-62e4-4ec2-bb1e-5f56425d40b7 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:40.194848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0e6330c7-62e4-4ec2-bb1e-5f56425d40b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:40.325643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9948fc-36ce-4eca-abf9-6bb3a0acbb6e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:40.327562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8e9948fc-36ce-4eca-abf9-6bb3a0acbb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:40.354501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 827/1656] 10.222.0.89 () {58 vars in 1059 bytes} [Tue Aug 30 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:40.371291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6330c7-62e4-4ec2-bb1e-5f56425d40b7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:40.373265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9948fc-36ce-4eca-abf9-6bb3a0acbb6e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:40.384784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:40.387207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:40.387485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:40.387756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] PATH_INFO: `/v3/projects/e1c5dd8afd5c4a9a9788049bafc872d2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:40.390205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6330c7-62e4-4ec2-bb1e-5f56425d40b7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:40.393159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c5dd8afd5c4a9a9788049bafc872d2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:40.394273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:02:40.394273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: warnings.warn(msg) Aug 30 01:02:40.394273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: Aug 30 01:02:40.397048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:40.404619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:40.404929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:40.405791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:40.406188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:40.406456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:40.427307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:40.429199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:40.442372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 828/1657] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:02:40.581408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c5dd8afd5c4a9a9788049bafc872d2', 'request_id': 'req-48474089-0b7e-49e5-a70f-95e8865718c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:40.624648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c5dd8afd5c4a9a9788049bafc872d2', 'request_id': 'req-48474089-0b7e-49e5-a70f-95e8865718c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:40.655465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c5dd8afd5c4a9a9788049bafc872d2', 'request_id': 'req-48474089-0b7e-49e5-a70f-95e8865718c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:40.693500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] The token cache is being invalidate because project e1c5dd8afd5c4a9a9788049bafc872d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:40.693842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:40.694652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48474089-0b7e-49e5-a70f-95e8865718c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:40.697835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 830/1658] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:40 2022] DELETE /identity/v3/projects/e1c5dd8afd5c4a9a9788049bafc872d2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:02:40.701981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:40.722225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab695d-9cfd-4b48-8cb0-515ab1373617 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:40.805820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:40.936321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:40.937044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:40.937321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:40.937590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] PATH_INFO: `/v3/users/1b2ac994ca634ddbaa33fb36a9bb561b` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:40.938804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2ac994ca634ddbaa33fb36a9bb561b)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:40.940723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:40.990793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885c99-7696-46a9-b714-b77507bad7f3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:40.991279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885c99-7696-46a9-b714-b77507bad7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:40.991366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885c99-7696-46a9-b714-b77507bad7f3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:40.992704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 831/1659] 10.222.0.89 () {54 vars in 912 bytes} [Tue Aug 30 01:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:41.008368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401942-054d-484d-b32b-869101493932 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:41.008646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401942-054d-484d-b32b-869101493932 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:41.009121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a401942-054d-484d-b32b-869101493932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:41.059984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2ac994ca634ddbaa33fb36a9bb561b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:41.069771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2ac994ca634ddbaa33fb36a9bb561b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:41.070118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7a401942-054d-484d-b32b-869101493932 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:41.080957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7a401942-054d-484d-b32b-869101493932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:41.088777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2ac994ca634ddbaa33fb36a9bb561b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:41.089427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2ac994ca634ddbaa33fb36a9bb561b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:41.116003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2ac994ca634ddbaa33fb36a9bb561b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:41.131266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 829/1660] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:40 2022] DELETE /identity/v3/users/1b2ac994ca634ddbaa33fb36a9bb561b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:41.340184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 832/1661] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:41.353470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:41.355237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:41.581415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59108e4f-c77e-4abf-b953-3cf918d8d734 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:41.590859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:41.591558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:41.591835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:41.593392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:41.682950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:41.770610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:41.773656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:41.802784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 830/1662] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:42.045029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a401942-054d-484d-b32b-869101493932 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:42.047733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7a401942-054d-484d-b32b-869101493932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:42.071016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a401942-054d-484d-b32b-869101493932 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:42.244461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:42.245787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:42.246063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:42.246326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] PATH_INFO: `/v3/projects/3204782516844498a28d5eac446ab72d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:42.253749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3204782516844498a28d5eac446ab72d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:42.255718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:42.342214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:42.382802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3204782516844498a28d5eac446ab72d', 'request_id': 'req-c85fb726-f656-4a6a-9011-31f9cb99c3f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.395847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3204782516844498a28d5eac446ab72d', 'request_id': 'req-c85fb726-f656-4a6a-9011-31f9cb99c3f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.410685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3204782516844498a28d5eac446ab72d', 'request_id': 'req-c85fb726-f656-4a6a-9011-31f9cb99c3f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.439380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] The token cache is being invalidate because project 3204782516844498a28d5eac446ab72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:42.439857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.442232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.447374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 833/1663] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:42 2022] DELETE /identity/v3/projects/3204782516844498a28d5eac446ab72d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:42.448155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:42.464505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f547-5810-474b-9cf9-4db1534a6377 service glance] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:42.505042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:42.506671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:42.634081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:42.635042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:42.635317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:42.635585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] PATH_INFO: `/v3/users/84a87a794ca645cf815a6e2e8a3da4ab` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:42.637351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a87a794ca645cf815a6e2e8a3da4ab)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:42.643164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:42.655964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fb726-f656-4a6a-9011-31f9cb99c3f9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:42.666459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:42.667292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:42.667677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:42.669103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] PATH_INFO: `/v3/projects/4b146360d4b340c79a089ea269bae791` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:42.672588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b146360d4b340c79a089ea269bae791)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:42.678572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:42.780232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a87a794ca645cf815a6e2e8a3da4ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.784213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b146360d4b340c79a089ea269bae791', 'request_id': 'req-f9ac55ff-ee4b-4e35-9291-93e9881745fc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.799245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b146360d4b340c79a089ea269bae791', 'request_id': 'req-f9ac55ff-ee4b-4e35-9291-93e9881745fc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.805055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a87a794ca645cf815a6e2e8a3da4ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.818693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b146360d4b340c79a089ea269bae791', 'request_id': 'req-f9ac55ff-ee4b-4e35-9291-93e9881745fc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.826245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a87a794ca645cf815a6e2e8a3da4ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.827856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a87a794ca645cf815a6e2e8a3da4ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.845074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] The token cache is being invalidate because project 4b146360d4b340c79a089ea269bae791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:42.845543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.846437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9ac55ff-ee4b-4e35-9291-93e9881745fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.850105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 834/1664] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:42 2022] DELETE /identity/v3/projects/4b146360d4b340c79a089ea269bae791 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:42.854884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857e11-2f05-4ca8-9bc5-be8de1429e5e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:42.855170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857e11-2f05-4ca8-9bc5-be8de1429e5e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:42.855441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857e11-2f05-4ca8-9bc5-be8de1429e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:42.862008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-678be61b-5f48-4add-8ae6-4766ec6ca965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a87a794ca645cf815a6e2e8a3da4ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:42.879889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 831/1665] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:42 2022] DELETE /identity/v3/users/84a87a794ca645cf815a6e2e8a3da4ab => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:02:42.909995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-38857e11-2f05-4ca8-9bc5-be8de1429e5e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:42.911384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-38857e11-2f05-4ca8-9bc5-be8de1429e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:43.015269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:43.055223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 835/1666] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:43.065515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3841-c395-4169-9790-f74063cf9ea1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.065849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3841-c395-4169-9790-f74063cf9ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.066077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3841-c395-4169-9790-f74063cf9ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.112736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-28df3841-c395-4169-9790-f74063cf9ea1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:43.114564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-28df3841-c395-4169-9790-f74063cf9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:43.141962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 832/1667] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:43.147152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38857e11-2f05-4ca8-9bc5-be8de1429e5e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.161556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38857e11-2f05-4ca8-9bc5-be8de1429e5e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:43.168892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4716e-0a19-481c-859e-286a8f766763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:43.169790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4716e-0a19-481c-859e-286a8f766763 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.170068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4716e-0a19-481c-859e-286a8f766763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.170378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4716e-0a19-481c-859e-286a8f766763 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.171873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4716e-0a19-481c-859e-286a8f766763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:43.172187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4716e-0a19-481c-859e-286a8f766763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:43.173978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4716e-0a19-481c-859e-286a8f766763 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:43.189548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 836/1668] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:43.194592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3841-c395-4169-9790-f74063cf9ea1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.205246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3841-c395-4169-9790-f74063cf9ea1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:43.210156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ace81-c168-444c-92b2-79d9b9739e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:43.210793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ace81-c168-444c-92b2-79d9b9739e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.211064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ace81-c168-444c-92b2-79d9b9739e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.211332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ace81-c168-444c-92b2-79d9b9739e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.211973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ace81-c168-444c-92b2-79d9b9739e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:43.214685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ace81-c168-444c-92b2-79d9b9739e31 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:43.248900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c67d5-c824-47f4-a9d7-7d613f63fb55 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.249127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c67d5-c824-47f4-a9d7-7d613f63fb55 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.249580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c67d5-c824-47f4-a9d7-7d613f63fb55 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.251357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 837/1669] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:43.270451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 833/1670] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:43 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:43.276017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c67d5-c824-47f4-a9d7-7d613f63fb55 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.299349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef29ba-e6e4-44f2-8da9-c6212d4ce205 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.299908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef29ba-e6e4-44f2-8da9-c6212d4ce205 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.300355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef29ba-e6e4-44f2-8da9-c6212d4ce205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.345769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d8ef29ba-e6e4-44f2-8da9-c6212d4ce205 None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:43.347268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d8ef29ba-e6e4-44f2-8da9-c6212d4ce205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:43.374545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:43.445829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c67d5-c824-47f4-a9d7-7d613f63fb55 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:43.451545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f3a2e-35fa-4757-b4ad-b43df7f86dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:43.453707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f3a2e-35fa-4757-b4ad-b43df7f86dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.453990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f3a2e-35fa-4757-b4ad-b43df7f86dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.454262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f3a2e-35fa-4757-b4ad-b43df7f86dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.455427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f3a2e-35fa-4757-b4ad-b43df7f86dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:43.457459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f3a2e-35fa-4757-b4ad-b43df7f86dc4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:43.495277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 838/1671] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:43 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:43.496903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6dbd-6456-4dcb-8531-f40d81291fed None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.497194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6dbd-6456-4dcb-8531-f40d81291fed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.497504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f6dbd-6456-4dcb-8531-f40d81291fed None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.501165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 839/1672] 10.222.0.89 () {54 vars in 912 bytes} [Tue Aug 30 01:02:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:43.502170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6dbd-6456-4dcb-8531-f40d81291fed None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.519033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f6dbd-6456-4dcb-8531-f40d81291fed None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:43.519290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 834/1673] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:43.524839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843273a-d74a-4359-8ab1-f2e0d832115f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.525340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843273a-d74a-4359-8ab1-f2e0d832115f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.525741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843273a-d74a-4359-8ab1-f2e0d832115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.526461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:43.527083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.527355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.527623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.528319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:43.530125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:43.544049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 840/1674] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:43.548977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.562833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b8a4-43a0-4f42-a525-314a1a04aa53 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:43.568603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:43.569309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.569626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.569892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.570538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:43.573702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:43.603032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 841/1675] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:02:43.603980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.606216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:43.623268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069974-85a2-45c8-86ef-89b6436077a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:43.630967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:43.632288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.632884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.633174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.644451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d843273a-d74a-4359-8ab1-f2e0d832115f None None] MFA Rules not processed for user `5007fe05c96e468b9dbc9b22ff1e2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:43.645970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d843273a-d74a-4359-8ab1-f2e0d832115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:43.650097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:43.652742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:43.679752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 842/1676] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:43.684397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.704608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583a25-ff34-404a-b578-5551ec6041bf service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:43.711185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:43.711868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.712517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.712795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] PATH_INFO: `/v3/projects/af0461129cf747a88dec7c6f8ed48898/users/814603d3e0f64b159935d2b03b7a2560/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.763658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0461129cf747a88dec7c6f8ed48898, user_id=814603d3e0f64b159935d2b03b7a2560, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:43.777543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:43.823929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 843/1677] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:43 2022] PUT /identity/v3/projects/af0461129cf747a88dec7c6f8ed48898/users/814603d3e0f64b159935d2b03b7a2560/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:43.835858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:43.839776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:43.862797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 835/1678] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:43.864778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:43.865132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:43.865341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:43.973700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] MFA Rules not processed for user `814603d3e0f64b159935d2b03b7a2560`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:43.978748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:44.052740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e313427-1027-4936-9a1f-90ab12e6bf0e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:44.073397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:44.075455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:44.075999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:44.076417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] PATH_INFO: `/v3/users/18bbd262271f4323acad6669d629f9f4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:44.082398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18bbd262271f4323acad6669d629f9f4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:44.085309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:44.094714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:44.200695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 836/1679] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:44.211102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:44.214952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18bbd262271f4323acad6669d629f9f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:44.215755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:44.275361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18bbd262271f4323acad6669d629f9f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:44.292738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18bbd262271f4323acad6669d629f9f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:44.295594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18bbd262271f4323acad6669d629f9f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:44.296906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18bbd262271f4323acad6669d629f9f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:44.339844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 844/1680] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:43 2022] DELETE /identity/v3/users/18bbd262271f4323acad6669d629f9f4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:44.340162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:44.343593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:44.355664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:44.399398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b9c7-d1e6-4bc4-8429-6169c9c9c630 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:44.464270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba084-8a73-4643-8eb0-f7236a707818 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:44.470277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:44.470919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:44.471197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:44.474234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:44.474939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:44.478720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:44.509739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:44.510403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:44.510688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:44.510965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:44.513028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:44.530385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:44.532262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:44.540086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 845/1681] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:44 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:44.545368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:44.551697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 837/1682] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:44.633468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e193a6d-7266-45e7-8fbb-d943838fa68d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:44.640341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:44.641017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:44.641292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:44.641558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:44.642245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:44.644835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:44.662413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:44.684565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 846/1683] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:44 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:44.689030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:44.705073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8604f8-e82c-4d92-a381-03e38d678d50 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:44.715848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:44.720435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:44.737430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:44.738022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:44.738958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:44.743300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:44.763236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 838/1684] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:44.763443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:44.790451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fde1c-2513-4de8-a75e-b554a858b7dd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:44.796677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:44.797408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:44.797685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:44.797954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] PATH_INFO: `/v3/projects/1e1e2bdc9ed44472bae6ca671f1cdcc0/users/ad262f0bf4de41b98566af1fb0c48355/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:44.837596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1e2bdc9ed44472bae6ca671f1cdcc0, user_id=ad262f0bf4de41b98566af1fb0c48355, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:44.840312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:44.876718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 847/1685] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:44 2022] PUT /identity/v3/projects/1e1e2bdc9ed44472bae6ca671f1cdcc0/users/ad262f0bf4de41b98566af1fb0c48355/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:44.884262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:44.931172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7470f-cda6-4fdb-b8b3-79642a24850a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:45.050518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5ca4-1579-4804-a8c8-7fb8ca20dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:45.051156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5ca4-1579-4804-a8c8-7fb8ca20dc37 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:45.051434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5ca4-1579-4804-a8c8-7fb8ca20dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:45.051707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5ca4-1579-4804-a8c8-7fb8ca20dc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:45.052362 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5ca4-1579-4804-a8c8-7fb8ca20dc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:45.053988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5ca4-1579-4804-a8c8-7fb8ca20dc37 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:45.078389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 839/1686] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:45.079704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:45.094082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84084682-ee57-43c3-9495-517ef88d6032 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:45.107279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:45.108110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:45.108396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:45.108673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] PATH_INFO: `/v3/projects/1e1e2bdc9ed44472bae6ca671f1cdcc0/users/ad262f0bf4de41b98566af1fb0c48355/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:45.113716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1e2bdc9ed44472bae6ca671f1cdcc0, user_id=ad262f0bf4de41b98566af1fb0c48355, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:45.120550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:45.141873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 848/1687] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:45 2022] PUT /identity/v3/projects/1e1e2bdc9ed44472bae6ca671f1cdcc0/users/ad262f0bf4de41b98566af1fb0c48355/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:45.147083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:45.147376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:45.147659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:45.213733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] MFA Rules not processed for user `ad262f0bf4de41b98566af1fb0c48355`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:45.215793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:45.343038 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 840/1688] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:45.350315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:45.352087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:45.466366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758ecb8-5b29-4ca0-8bde-a90fb4f0e20a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:45.479535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:45.481307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:45.481594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:45.482865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:45.483160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:45.483426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:45.492490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:45.506125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:45.507563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:45.531067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 849/1689] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:45.565264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:45.632777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4bc60-ba87-4232-b3e0-38da606108ae None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:45.640396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:45.641279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:45.641664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:45.642039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] PATH_INFO: `/v3/projects/4cbcce7c24da4903be78df680ac5691e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:45.643528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbcce7c24da4903be78df680ac5691e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:45.647510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:45.701164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe6869-6c5d-4ea8-b879-fb0af1234063 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:45.710832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:45.711487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:45.711770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:45.712093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] PATH_INFO: `/v3/users/814603d3e0f64b159935d2b03b7a2560` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:45.713463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814603d3e0f64b159935d2b03b7a2560)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:45.715405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:45.735878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbcce7c24da4903be78df680ac5691e', 'request_id': 'req-345ec40e-0e15-4a11-8add-50da57013fab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.745709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbcce7c24da4903be78df680ac5691e', 'request_id': 'req-345ec40e-0e15-4a11-8add-50da57013fab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.760447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbcce7c24da4903be78df680ac5691e', 'request_id': 'req-345ec40e-0e15-4a11-8add-50da57013fab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.781263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] The token cache is being invalidate because project 4cbcce7c24da4903be78df680ac5691e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:45.781631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.782451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.786405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 841/1690] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:45 2022] DELETE /identity/v3/projects/4cbcce7c24da4903be78df680ac5691e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:45.787725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:45.790185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:45.834850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814603d3e0f64b159935d2b03b7a2560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.872304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:45.873444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814603d3e0f64b159935d2b03b7a2560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.892663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814603d3e0f64b159935d2b03b7a2560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.894802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814603d3e0f64b159935d2b03b7a2560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.895453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814603d3e0f64b159935d2b03b7a2560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:45.919845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 850/1691] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:45 2022] DELETE /identity/v3/users/814603d3e0f64b159935d2b03b7a2560 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:02:45.921781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ec40e-0e15-4a11-8add-50da57013fab admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:45.925262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:45.929352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:46.017842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:46.054194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:46.054303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:46.054645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:46.054807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] PATH_INFO: `/v3/projects/591854270f534bfcbb56f97b0738d286` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:46.064761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591854270f534bfcbb56f97b0738d286)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:46.066763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:46.146600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caef9d-9711-4202-8d46-c2dd01795760 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:46.154275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591854270f534bfcbb56f97b0738d286', 'request_id': 'req-3f437b78-61c8-459a-b5a4-6d8faa3df054'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.168977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591854270f534bfcbb56f97b0738d286', 'request_id': 'req-3f437b78-61c8-459a-b5a4-6d8faa3df054'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.185377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591854270f534bfcbb56f97b0738d286', 'request_id': 'req-3f437b78-61c8-459a-b5a4-6d8faa3df054'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.225053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] The token cache is being invalidate because project 591854270f534bfcbb56f97b0738d286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:46.225426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.226224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3f437b78-61c8-459a-b5a4-6d8faa3df054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.231628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 842/1692] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:45 2022] DELETE /identity/v3/projects/591854270f534bfcbb56f97b0738d286 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:46.236633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b0fc-163a-4d21-996d-a409c989b3ed None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:46.237010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b0fc-163a-4d21-996d-a409c989b3ed None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:46.237212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b0fc-163a-4d21-996d-a409c989b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:46.303763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c399b0fc-163a-4d21-996d-a409c989b3ed None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:46.305968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c399b0fc-163a-4d21-996d-a409c989b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:46.393577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:46.394291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:46.400445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:46.402441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] PATH_INFO: `/v3/users/2941f514b2a24a1ba28f696bfbcd7c8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:46.409609 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2941f514b2a24a1ba28f696bfbcd7c8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:46.422617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:46.587720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 843/1693] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:46.588153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2941f514b2a24a1ba28f696bfbcd7c8f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.589502 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:46.589892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:46.590265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:46.635913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2941f514b2a24a1ba28f696bfbcd7c8f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.637388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:46.638742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:46.661233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2941f514b2a24a1ba28f696bfbcd7c8f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.661958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2941f514b2a24a1ba28f696bfbcd7c8f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.665720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7257a18-ad25-4f79-955b-0eaf13c00ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2941f514b2a24a1ba28f696bfbcd7c8f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:46.666168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 844/1694] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:46.667239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:46.671164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:46.723901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 851/1695] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:45 2022] DELETE /identity/v3/users/2941f514b2a24a1ba28f696bfbcd7c8f => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:46.726671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:46.726976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:46.727243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:46.769960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:46.796717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:46.804248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:46.909299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70121-5883-435e-b8b0-90eecf421fc5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:46.918078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:47.001407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 852/1696] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:47.005500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:47.013071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:47.066328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:47.066968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.067249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.067521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.069762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:47.105975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:47.107676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:47.130845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 845/1697] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:47.131835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:47.154222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc8e6f-b492-4ccd-8ce3-d718958d838e service placement] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:47.164632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee049e-eef4-4ddc-8a3d-3559f7c3e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:47.165315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee049e-eef4-4ddc-8a3d-3559f7c3e4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.165662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee049e-eef4-4ddc-8a3d-3559f7c3e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.165937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee049e-eef4-4ddc-8a3d-3559f7c3e4d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.166696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee049e-eef4-4ddc-8a3d-3559f7c3e4d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:47.166985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee049e-eef4-4ddc-8a3d-3559f7c3e4d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:47.168588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee049e-eef4-4ddc-8a3d-3559f7c3e4d2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:47.169850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7df3d-8627-4314-b692-2da1d68a1249 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:47.180386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a8893-c79e-467c-8675-d17850e99584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:47.181299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a8893-c79e-467c-8675-d17850e99584 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.181719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a8893-c79e-467c-8675-d17850e99584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.182131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a8893-c79e-467c-8675-d17850e99584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.185859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-064a8893-c79e-467c-8675-d17850e99584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:47.208112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 846/1698] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:47.209482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0d11a-2bb6-4ac3-bb1f-a7f18dcdac36 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.209798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0d11a-2bb6-4ac3-bb1f-a7f18dcdac36 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.210074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0d11a-2bb6-4ac3-bb1f-a7f18dcdac36 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.212094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 847/1699] 10.222.0.89 () {54 vars in 962 bytes} [Tue Aug 30 01:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:47.217120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0d11a-2bb6-4ac3-bb1f-a7f18dcdac36 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:47.233528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a8893-c79e-467c-8675-d17850e99584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:47.235351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a8893-c79e-467c-8675-d17850e99584 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:47.247043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0d11a-2bb6-4ac3-bb1f-a7f18dcdac36 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:47.259140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:47.259773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.260051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.260309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.261020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:47.266496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:47.267564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 853/1700] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:47.269457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d534-a063-4d6c-b748-4208b97c5a5c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.269740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d534-a063-4d6c-b748-4208b97c5a5c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.270014 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d534-a063-4d6c-b748-4208b97c5a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.320508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c832d534-a063-4d6c-b748-4208b97c5a5c None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:47.321925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c832d534-a063-4d6c-b748-4208b97c5a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:47.368986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 848/1701] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:47 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:47.404741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:47.525032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 854/1702] 10.222.0.89 () {58 vars in 1059 bytes} [Tue Aug 30 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:47.526940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f41645-6ab8-4ea1-9781-c4709f18efa5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.527233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f41645-6ab8-4ea1-9781-c4709f18efa5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.527506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f41645-6ab8-4ea1-9781-c4709f18efa5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.535584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 855/1703] 10.222.0.89 () {54 vars in 912 bytes} [Tue Aug 30 01:02:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:02:47.537383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5daa4-4d05-4517-a6d2-ababbabe2093 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.537577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5daa4-4d05-4517-a6d2-ababbabe2093 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.537849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5daa4-4d05-4517-a6d2-ababbabe2093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.599931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-88e5daa4-4d05-4517-a6d2-ababbabe2093 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:47.601163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88e5daa4-4d05-4517-a6d2-ababbabe2093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:47.637692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437523-96ac-468b-a710-43ab5d782e25 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:47.653661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:47.655406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.655847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.656408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.657246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:47.659413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:47.707643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 849/1704] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:47 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:47.710718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:47.736554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:47.763588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b740b1-1d5f-4799-9000-dc55730481f2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:47.785820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:47.786461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.786736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.787006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.788299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:47.789952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:47.803493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 856/1705] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:47.812714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 850/1706] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:47.813482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:47.816082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.816496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.816936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.822727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:47.838505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc4c0a-d077-4a1a-9bd0-52981f04637f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:47.846885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:47.847547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:47.847886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:47.848282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] PATH_INFO: `/v3/projects/d4a3ef88033a45c5a4cfdfec87ab5bb5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:47.849907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a3ef88033a45c5a4cfdfec87ab5bb5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:47.852184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:47.926463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] MFA Rules not processed for user `40ed6647aea94ff9b717b79a34faa3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:47.930749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:47.943037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:47.965825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a3ef88033a45c5a4cfdfec87ab5bb5', 'request_id': 'req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:47.990962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a3ef88033a45c5a4cfdfec87ab5bb5', 'request_id': 'req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:48.023130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a3ef88033a45c5a4cfdfec87ab5bb5', 'request_id': 'req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:48.063340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] The token cache is being invalidate because project d4a3ef88033a45c5a4cfdfec87ab5bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:48.063632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:48.064327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:48.067309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 851/1707] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:47 2022] DELETE /identity/v3/projects/d4a3ef88033a45c5a4cfdfec87ab5bb5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:48.068703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:48.071411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.133328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 857/1708] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:48.134384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:48.137722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.247700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e88d-1ee8-4574-8ec0-f2e42d30c4a0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:48.257684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6775c-6884-4478-b239-bc6f7ebe5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:48.258334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6775c-6884-4478-b239-bc6f7ebe5436 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.258615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6775c-6884-4478-b239-bc6f7ebe5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.259474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6775c-6884-4478-b239-bc6f7ebe5436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.261093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6775c-6884-4478-b239-bc6f7ebe5436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:48.262994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6775c-6884-4478-b239-bc6f7ebe5436 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:48.273958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2c5f7-70f0-4e2f-8034-f47457f99136 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:48.283301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:48.284072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.284475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.284758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 852/1709] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:48.285167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.286263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ebc11-8c3e-497a-bc57-80c5250554e3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.286546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ebc11-8c3e-497a-bc57-80c5250554e3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.286811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ebc11-8c3e-497a-bc57-80c5250554e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.287982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.340126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-241ebc11-8c3e-497a-bc57-80c5250554e3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:48.343440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-241ebc11-8c3e-497a-bc57-80c5250554e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.366791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 853/1710] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:48.368390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d570-cdfb-47f7-ae3f-da2788351099 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.370538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d570-cdfb-47f7-ae3f-da2788351099 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.373236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d570-cdfb-47f7-ae3f-da2788351099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.407282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:48.409503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:48.423455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 858/1711] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:48.424448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:48.427493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4355d570-cdfb-47f7-ae3f-da2788351099 None None] MFA Rules not processed for user `40ed6647aea94ff9b717b79a34faa3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:48.428739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4355d570-cdfb-47f7-ae3f-da2788351099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.431549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:48.439201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba684c0-bcb7-4ebf-820f-7bda7eca691e service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:48.457498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 854/1712] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:48.458730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:48.459827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.460343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.460485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.460747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.461058 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.462272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] PATH_INFO: `/v3/projects/39d064a33b194661a3708144deabe651/users/a9e8891abdbd454595a8dfe38a0c039a/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.507330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d064a33b194661a3708144deabe651, user_id=a9e8891abdbd454595a8dfe38a0c039a, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:48.508082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:48.509947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.516665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:48.522702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 855/1713] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:48.523785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:48.525696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.549529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 859/1714] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:48 2022] PUT /identity/v3/projects/39d064a33b194661a3708144deabe651/users/a9e8891abdbd454595a8dfe38a0c039a/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:48.550212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:48.554787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0212c-afb2-4e45-a8e4-949989871ed1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:48.767792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9544c-27a9-4bea-a1be-b6d96746b4f1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:48.775845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:48.776648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.776962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.777225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.787954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04e22b-d9ee-4530-a57f-4ccd7090fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:48.789060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04e22b-d9ee-4530-a57f-4ccd7090fe40 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.789465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04e22b-d9ee-4530-a57f-4ccd7090fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.789825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04e22b-d9ee-4530-a57f-4ccd7090fe40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.790670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04e22b-d9ee-4530-a57f-4ccd7090fe40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:48.791351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04e22b-d9ee-4530-a57f-4ccd7090fe40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:48.794241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04e22b-d9ee-4530-a57f-4ccd7090fe40 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:48.823815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 860/1715] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:48.825156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3097a-3278-4081-a3de-b61239e8e1e2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.825443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3097a-3278-4081-a3de-b61239e8e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.825713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3097a-3278-4081-a3de-b61239e8e1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.854025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:48.877784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-99c3097a-3278-4081-a3de-b61239e8e1e2 None None] MFA Rules not processed for user `a9e8891abdbd454595a8dfe38a0c039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:48.881270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99c3097a-3278-4081-a3de-b61239e8e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:48.910764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:48.912427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:48.930985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 856/1716] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:48.932668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:48.963812 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28c5f1-6662-487b-868a-05d0a1d81fc1 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:48.973451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:48.974098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:48.974381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:48.974710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:48.975366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:48.977497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.039075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 857/1717] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:48 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:49.048440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.087657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 861/1718] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:49.089796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3097a-3278-4081-a3de-b61239e8e1e2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.101603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3097a-3278-4081-a3de-b61239e8e1e2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.211417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672489cc-c35d-4ea0-a872-a050243896ac admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.221859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.222829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.223393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.224386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.225278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.228219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.249643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.250866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.252107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.253739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.254572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.260046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.301643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 858/1719] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:49 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:49.301643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.303759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:49.323918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a7478-8e8b-4abe-9390-540223998578 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.329184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.329858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.330144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.330420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] PATH_INFO: `/v3/projects/af0461129cf747a88dec7c6f8ed48898` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.334126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0461129cf747a88dec7c6f8ed48898)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.336069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.338501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:49.405488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 862/1720] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:49 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:49.405488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.423790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0461129cf747a88dec7c6f8ed48898', 'request_id': 'req-7be94d1f-d4ce-461d-afe7-838ff7446cb3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.439869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0461129cf747a88dec7c6f8ed48898', 'request_id': 'req-7be94d1f-d4ce-461d-afe7-838ff7446cb3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.457326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0461129cf747a88dec7c6f8ed48898', 'request_id': 'req-7be94d1f-d4ce-461d-afe7-838ff7446cb3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.479908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] The token cache is being invalidate because project af0461129cf747a88dec7c6f8ed48898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:49.480251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.485035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.487580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 859/1721] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:49 2022] DELETE /identity/v3/projects/af0461129cf747a88dec7c6f8ed48898 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:49.494114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.496391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:49.545744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda8c5-a1d3-41b2-81fe-a56e7de7f04d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.564356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.565359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.565779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.566346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.567144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.569718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.618135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:49.619339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 863/1722] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:49.622901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.628415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:49.685443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a33d-5b41-4c7b-8d63-7d4309e07114 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.709533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.709848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.710108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.710378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] PATH_INFO: `/v3/users/ad262f0bf4de41b98566af1fb0c48355` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.712956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad262f0bf4de41b98566af1fb0c48355)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.714977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.717992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94d1f-d4ce-461d-afe7-838ff7446cb3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.732066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.732066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.733311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.733620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.734989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.737848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.813124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad262f0bf4de41b98566af1fb0c48355'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.832583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 860/1723] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:49 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:49.834846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.840094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:49.904743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad262f0bf4de41b98566af1fb0c48355'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.928916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610215e-8068-4612-a12c-b3117fd6ab2c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:49.951679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:49.953622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad262f0bf4de41b98566af1fb0c48355'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.955106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:49.955106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:49.955106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:49.955731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad262f0bf4de41b98566af1fb0c48355'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.956553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:49.957136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad262f0bf4de41b98566af1fb0c48355'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:49.961197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:49.984252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 864/1724] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:49 2022] DELETE /identity/v3/users/ad262f0bf4de41b98566af1fb0c48355 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:49.986363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:49.995819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 861/1725] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:50.001410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:50.005682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:50.009129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:50.052571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b280604-5c76-4ce6-910a-400f36b6ca20 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.152596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:50.163134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4a14-6d9d-41d9-b349-66ec7161f6cc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.178718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.181325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.183628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.183628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.185226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.192773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.215423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff373f30-d565-46d0-a3a5-81ef7997328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.216489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff373f30-d565-46d0-a3a5-81ef7997328b admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.217071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff373f30-d565-46d0-a3a5-81ef7997328b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.217721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff373f30-d565-46d0-a3a5-81ef7997328b admin admin] PATH_INFO: `/v3/projects/c402517007614c68b950d08229ea0e0c/users/95bbe76e77d04807b9de93d568c8b877/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.230383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 865/1726] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:50.235224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:50.244312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff373f30-d565-46d0-a3a5-81ef7997328b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c402517007614c68b950d08229ea0e0c, user_id=95bbe76e77d04807b9de93d568c8b877, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.248749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff373f30-d565-46d0-a3a5-81ef7997328b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.251764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c516-c5c3-42fa-bd25-c2f0c086be21 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.266849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.268040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.268328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.268609 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] PATH_INFO: `/v3/projects/638a4669a1aa43a88d5b8bc44a96ba2b/users/b9178b8239264546a39b900647a54225/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.272883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 862/1727] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:49 2022] PUT /identity/v3/projects/c402517007614c68b950d08229ea0e0c/users/95bbe76e77d04807b9de93d568c8b877/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:50.309049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caede-ed9a-4b90-b3d6-2889e427de6f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.309536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caede-ed9a-4b90-b3d6-2889e427de6f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.310333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caede-ed9a-4b90-b3d6-2889e427de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.314178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638a4669a1aa43a88d5b8bc44a96ba2b, user_id=b9178b8239264546a39b900647a54225, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.317619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.344960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 866/1728] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:50 2022] PUT /identity/v3/projects/638a4669a1aa43a88d5b8bc44a96ba2b/users/b9178b8239264546a39b900647a54225/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:02:50.346455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:50.388417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b49caede-ed9a-4b90-b3d6-2889e427de6f None None] MFA Rules not processed for user `95bbe76e77d04807b9de93d568c8b877`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:50.390056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b49caede-ed9a-4b90-b3d6-2889e427de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:50.539265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179a4f-0cf7-4fe6-bbfa-17376c8344c9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.553761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.553761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.553761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.553761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.554235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.554320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.598943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 867/1729] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:50.601086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:50.637393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df21-16dd-4347-8262-0cb6f20f695e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.644918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 863/1730] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:50.646160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.646283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.646936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.646936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.647938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.648652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.649205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] PATH_INFO: `/v3/projects/638a4669a1aa43a88d5b8bc44a96ba2b/users/b9178b8239264546a39b900647a54225/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.663839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638a4669a1aa43a88d5b8bc44a96ba2b, user_id=b9178b8239264546a39b900647a54225, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.677823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.719050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 868/1731] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:50 2022] PUT /identity/v3/projects/638a4669a1aa43a88d5b8bc44a96ba2b/users/b9178b8239264546a39b900647a54225/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:50.723074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:50.784525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:50.823199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:50.824592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:50.867949 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47925eb5-c56f-450a-b0ea-7e591c9515e5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:50.885056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfc1bb-0281-4758-b91b-05285a9be567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:50.885845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc1bb-0281-4758-b91b-05285a9be567 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.886275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc1bb-0281-4758-b91b-05285a9be567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.886797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc1bb-0281-4758-b91b-05285a9be567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:50.887942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfc1bb-0281-4758-b91b-05285a9be567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:50.895212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfc1bb-0281-4758-b91b-05285a9be567 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:50.951960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 869/1732] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:50 2022] POST /identity/v3/projects => generated 365 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:50.952603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f56d5-5678-481c-ab79-be5956ccf027 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:50.952970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f56d5-5678-481c-ab79-be5956ccf027 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:50.953259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f56d5-5678-481c-ab79-be5956ccf027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:51.007383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 864/1733] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:51.009844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:51.056771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:51.099024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d88f56d5-5678-481c-ab79-be5956ccf027 None None] MFA Rules not processed for user `b9178b8239264546a39b900647a54225`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:51.100325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d88f56d5-5678-481c-ab79-be5956ccf027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:51.120323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44340b-5e4a-4ce1-a535-9378e260d588 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:51.183605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:51.303546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:51.304179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:51.304475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:51.304760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] PATH_INFO: `/v3/projects/1e1e2bdc9ed44472bae6ca671f1cdcc0` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:51.308754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1e2bdc9ed44472bae6ca671f1cdcc0)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:51.319265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:51.357871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 870/1734] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:51.358911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f56d5-5678-481c-ab79-be5956ccf027 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:51.410808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f56d5-5678-481c-ab79-be5956ccf027 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:51.436934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:51.437580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:51.437853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:51.438122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:51.439220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:51.440905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:51.456141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1e2bdc9ed44472bae6ca671f1cdcc0', 'request_id': 'req-a13e5014-91a9-4ac9-8ebd-89411a068db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:51.470794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1e2bdc9ed44472bae6ca671f1cdcc0', 'request_id': 'req-a13e5014-91a9-4ac9-8ebd-89411a068db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:51.483109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1e2bdc9ed44472bae6ca671f1cdcc0', 'request_id': 'req-a13e5014-91a9-4ac9-8ebd-89411a068db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:51.493010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 871/1735] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:51 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:51.493970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:51.497069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:51.513891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] The token cache is being invalidate because project 1e1e2bdc9ed44472bae6ca671f1cdcc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:51.514194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:51.514891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:51.520499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 865/1736] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:51 2022] DELETE /identity/v3/projects/1e1e2bdc9ed44472bae6ca671f1cdcc0 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:51.520499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:51.520499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:51.593379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:51.718570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5014-91a9-4ac9-8ebd-89411a068db6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:51.728579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:51.729612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:51.730316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:51.730793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:51.734480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:51.796701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c205df-2ae6-40db-9f03-c895abb8dc13 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:51.906852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:51.908671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:51.923302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 866/1737] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:51.924328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:51.924694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a6f70-f1c6-4e5b-ba4d-6c4c069cca6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:51.925898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6f70-f1c6-4e5b-ba4d-6c4c069cca6e service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:51.926180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6f70-f1c6-4e5b-ba4d-6c4c069cca6e service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:51.926450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6f70-f1c6-4e5b-ba4d-6c4c069cca6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:51.930337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b47a6f70-f1c6-4e5b-ba4d-6c4c069cca6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:51.932275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:52.002624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:52.089977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c52370-0013-469c-81c4-8eccc519986b service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:52.101923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:52.102995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.103276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.103538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.104202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:52.105872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:52.106549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a6f70-f1c6-4e5b-ba4d-6c4c069cca6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:52.108655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a6f70-f1c6-4e5b-ba4d-6c4c069cca6e service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:52.122734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 872/1738] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:52.127631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.128120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.128577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.135088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 867/1739] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:52.139283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:52.168622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a71c-f22c-4aa3-a0cf-ff0e5d6f957c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:52.178258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590a0aa-e907-42b9-a6db-c288807e0343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:52.178994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590a0aa-e907-42b9-a6db-c288807e0343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.180872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590a0aa-e907-42b9-a6db-c288807e0343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.181523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590a0aa-e907-42b9-a6db-c288807e0343 admin admin] PATH_INFO: `/v3/projects/3082f9d17a4b49e0a131af0f3fc3f353/users/0bb2c4e803984a528204367113314a5f/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.200258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:52.203805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:52.230076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590a0aa-e907-42b9-a6db-c288807e0343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3082f9d17a4b49e0a131af0f3fc3f353, user_id=0bb2c4e803984a528204367113314a5f, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:52.234554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590a0aa-e907-42b9-a6db-c288807e0343 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:52.241247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 873/1740] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:52.242513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:52.251853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:52.280718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 868/1741] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:52 2022] PUT /identity/v3/projects/3082f9d17a4b49e0a131af0f3fc3f353/users/0bb2c4e803984a528204367113314a5f/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:52.282483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c00dd-973d-4ad7-98e5-aa2024afd7b6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.285076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c00dd-973d-4ad7-98e5-aa2024afd7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.285680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c00dd-973d-4ad7-98e5-aa2024afd7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.308203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584c061-bdc2-402a-842d-160556e3d011 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:52.369200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7c1c00dd-973d-4ad7-98e5-aa2024afd7b6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:52.370763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7c1c00dd-973d-4ad7-98e5-aa2024afd7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:52.496939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:52.502145 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:52.503093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.503387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.503666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] PATH_INFO: `/v3/users/a9e8891abdbd454595a8dfe38a0c039a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.506446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e8891abdbd454595a8dfe38a0c039a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:52.513083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:52.534408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 869/1742] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:52.535714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c00dd-973d-4ad7-98e5-aa2024afd7b6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:52.558293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c00dd-973d-4ad7-98e5-aa2024afd7b6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:52.571039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:52.572640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.573286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.574792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.577700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:52.580957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:52.614069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 870/1743] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:52.615799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:52.617930 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e8891abdbd454595a8dfe38a0c039a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:52.648736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e8891abdbd454595a8dfe38a0c039a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:52.663447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b44f1-c485-47ac-a4cd-09fb465cf660 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:52.668019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e8891abdbd454595a8dfe38a0c039a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:52.668605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e8891abdbd454595a8dfe38a0c039a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:52.669333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e8891abdbd454595a8dfe38a0c039a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:52.671476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf756f0-3e57-4df3-a960-070992e2ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:52.672004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf756f0-3e57-4df3-a960-070992e2ad37 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.672289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf756f0-3e57-4df3-a960-070992e2ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.672566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf756f0-3e57-4df3-a960-070992e2ad37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.673365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf756f0-3e57-4df3-a960-070992e2ad37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:02:52.674087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf756f0-3e57-4df3-a960-070992e2ad37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:52.676384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf756f0-3e57-4df3-a960-070992e2ad37 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:52.705199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 874/1744] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:52 2022] DELETE /identity/v3/users/a9e8891abdbd454595a8dfe38a0c039a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:52.706747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:52.710421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 871/1745] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:02:52.721768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.721768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.721768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.727893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:52.762710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:52.765772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:52.857979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:52.900734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b5d3-4d04-420b-a3ec-140f02bea1e5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:52.913974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:52.914663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:52.914940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:52.915213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] PATH_INFO: `/v3/projects/3082f9d17a4b49e0a131af0f3fc3f353/users/0bb2c4e803984a528204367113314a5f/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:52.918516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3082f9d17a4b49e0a131af0f3fc3f353, user_id=0bb2c4e803984a528204367113314a5f, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:52.921511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:52.926592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 872/1746] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:52.927584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:52.928960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:52.965845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae240f8-0b5b-4034-8f9c-e72d3411b2bf None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:52.975564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 875/1747] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:52 2022] PUT /identity/v3/projects/3082f9d17a4b49e0a131af0f3fc3f353/users/0bb2c4e803984a528204367113314a5f/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:52.976585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:52.987647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:53.181684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3917b22-c8ea-4743-88b2-954631711c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:53.182256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3917b22-c8ea-4743-88b2-954631711c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:53.182494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3917b22-c8ea-4743-88b2-954631711c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:53.182714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3917b22-c8ea-4743-88b2-954631711c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:53.183398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3917b22-c8ea-4743-88b2-954631711c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:53.185517 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3917b22-c8ea-4743-88b2-954631711c84 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:53.196988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029310-b3f1-483a-9fae-0908b719c17c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:53.205193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed155cd-6499-4ff7-b139-d77f5c24a401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:53.205886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed155cd-6499-4ff7-b139-d77f5c24a401 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:53.206167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed155cd-6499-4ff7-b139-d77f5c24a401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:53.206440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed155cd-6499-4ff7-b139-d77f5c24a401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:53.240181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed155cd-6499-4ff7-b139-d77f5c24a401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:53.242035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed155cd-6499-4ff7-b139-d77f5c24a401 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:53.270407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 873/1748] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:52 2022] POST /identity/v3/projects => generated 409 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:53.271966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:53.272258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:53.272540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:53.280893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 876/1749] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:53.284012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c24d91-fcdb-413c-b5cc-1b2606b94c8c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:53.284566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c24d91-fcdb-413c-b5cc-1b2606b94c8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:53.285735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c24d91-fcdb-413c-b5cc-1b2606b94c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:53.350681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c2c24d91-fcdb-413c-b5cc-1b2606b94c8c None None] MFA Rules not processed for user `40ed6647aea94ff9b717b79a34faa3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:53.355226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c2c24d91-fcdb-413c-b5cc-1b2606b94c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:53.380244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] MFA Rules not processed for user `0bb2c4e803984a528204367113314a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:53.383653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:53.492848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:53.539080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 877/1750] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:53.541320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c24d91-fcdb-413c-b5cc-1b2606b94c8c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:53.587705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 874/1751] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:53.600626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:53.602239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:53.806984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c24d91-fcdb-413c-b5cc-1b2606b94c8c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:53.828342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:53.840668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:53.841105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:53.841431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:53.842621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:53.862569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:53.893333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d0e64-c7bb-4f62-8e3b-acc9654ac744 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:53.901250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:53.902255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:53.902533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:53.902803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:53.932946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:53.933370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 878/1752] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:53 2022] POST /identity/v3/users => generated 305 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:53.935846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:53.941702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:53.951586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 875/1753] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:02:53.957007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a7224-d38d-47d8-b45f-1dcd591e3528 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:53.963434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eff500-6d9d-4f5a-a838-ebc440c4acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:53.964702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff500-6d9d-4f5a-a838-ebc440c4acf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:53.965201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff500-6d9d-4f5a-a838-ebc440c4acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:53.965977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eff500-6d9d-4f5a-a838-ebc440c4acf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:53.967573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eff500-6d9d-4f5a-a838-ebc440c4acf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:53.969595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eff500-6d9d-4f5a-a838-ebc440c4acf1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:53.981389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 879/1754] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:53.986882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:54.007149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:54.007611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:54.008019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:54.011675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06982e-9699-4328-8788-2bdcc2c35fc0 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:54.019381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:54.029539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:54.031328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:54.031848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:54.033301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:54.034633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:54.037919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:54.068865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 876/1755] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:54.077370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:54.107272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b5d12-534d-41e2-8328-545ce2f952be admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:54.125901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888ed4b-92e9-4400-886d-3c9a36f0b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:54.126304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] MFA Rules not processed for user `e2b354bfe62742e3bce1b8ec7eb85e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:54.127156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ed4b-92e9-4400-886d-3c9a36f0b718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:54.128623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:54.129745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ed4b-92e9-4400-886d-3c9a36f0b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:54.130073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888ed4b-92e9-4400-886d-3c9a36f0b718 admin admin] PATH_INFO: `/v3/projects/5ced8a48a562478487cb364693a2584e/users/9d1a51debe33474a9610956f777f5670/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:54.174595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888ed4b-92e9-4400-886d-3c9a36f0b718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ced8a48a562478487cb364693a2584e, user_id=9d1a51debe33474a9610956f777f5670, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:54.224281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888ed4b-92e9-4400-886d-3c9a36f0b718 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:54.303561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 877/1756] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:54 2022] PUT /identity/v3/projects/5ced8a48a562478487cb364693a2584e/users/9d1a51debe33474a9610956f777f5670/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:54.312218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea32744-bffc-4928-96b8-e6ea827b1751 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:54.312218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea32744-bffc-4928-96b8-e6ea827b1751 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:54.312520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea32744-bffc-4928-96b8-e6ea827b1751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:54.403635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 880/1757] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:02:54.421678 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:54.423216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:54.447534 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6ea32744-bffc-4928-96b8-e6ea827b1751 None None] MFA Rules not processed for user `9d1a51debe33474a9610956f777f5670`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:54.450266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6ea32744-bffc-4928-96b8-e6ea827b1751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:54.638995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 878/1758] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:54.644642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5908-14df-47c3-bf83-7a875a6e553f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:54.644642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5908-14df-47c3-bf83-7a875a6e553f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:54.644642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5908-14df-47c3-bf83-7a875a6e553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:54.708482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-44be5908-14df-47c3-bf83-7a875a6e553f None None] MFA Rules not processed for user `ec329f81679e4ffa83174d621b4440d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:54.710825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-44be5908-14df-47c3-bf83-7a875a6e553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:54.760871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:54.796279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e89001-ac04-4e4d-97e5-1fb8249b73fd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:54.970014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 879/1759] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:54.973389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5908-14df-47c3-bf83-7a875a6e553f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:55.053171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67923cca-e292-41c7-ab30-2885367f98be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.053829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67923cca-e292-41c7-ab30-2885367f98be service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.054107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67923cca-e292-41c7-ab30-2885367f98be service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.054377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67923cca-e292-41c7-ab30-2885367f98be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.159991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:55.244526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67923cca-e292-41c7-ab30-2885367f98be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:55.246606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67923cca-e292-41c7-ab30-2885367f98be service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:55.270854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 881/1760] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 850 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:02:55.273923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5908-14df-47c3-bf83-7a875a6e553f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:55.275335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b324c4-6084-49fe-a758-f09387d199c2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.276245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b324c4-6084-49fe-a758-f09387d199c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.276938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b324c4-6084-49fe-a758-f09387d199c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.309270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.312367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.314420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.314708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.315628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:55.324356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:55.327776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c5b324c4-6084-49fe-a758-f09387d199c2 None None] MFA Rules not processed for user `5007fe05c96e468b9dbc9b22ff1e2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:55.330348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5b324c4-6084-49fe-a758-f09387d199c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:55.427299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 880/1761] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:02:54 2022] POST /identity/v3/projects => generated 407 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:55.428262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:55.437956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:55.562713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 882/1762] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:55.577238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b324c4-6084-49fe-a758-f09387d199c2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:55.646506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b324c4-6084-49fe-a758-f09387d199c2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:55.758840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87dbb6-d7a6-4500-b555-e33036358daa admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:55.771838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.773829 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.774137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.774551 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] PATH_INFO: `/v3/projects/39d064a33b194661a3708144deabe651` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.775924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d064a33b194661a3708144deabe651)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:55.785723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:55.943402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:55.946081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:55.946521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:55.946838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] PATH_INFO: `/v3/users/95bbe76e77d04807b9de93d568c8b877` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:55.950704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bbe76e77d04807b9de93d568c8b877)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:55.967897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:55.985889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:56.000820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d064a33b194661a3708144deabe651', 'request_id': 'req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.034640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d064a33b194661a3708144deabe651', 'request_id': 'req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.053537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d064a33b194661a3708144deabe651', 'request_id': 'req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.109398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] The token cache is being invalidate because project 39d064a33b194661a3708144deabe651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:02:56.109941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.114712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.125990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 881/1763] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:55 2022] DELETE /identity/v3/projects/39d064a33b194661a3708144deabe651 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:56.127215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:56.133848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:56.177374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bbe76e77d04807b9de93d568c8b877'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.238446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bbe76e77d04807b9de93d568c8b877'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.273149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bbe76e77d04807b9de93d568c8b877'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.275783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bbe76e77d04807b9de93d568c8b877'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.277566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bbe76e77d04807b9de93d568c8b877'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:56.295957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:56.346674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 883/1764] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:55 2022] DELETE /identity/v3/users/95bbe76e77d04807b9de93d568c8b877 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:56.351944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:56.360749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:56.459748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3cea1-4685-4338-bbfa-4eda7f07e4f9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:56.582717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77b1b-c8e2-48cf-ba01-fba772d35a0e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:56.599557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:56.600776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:56.601102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:56.601385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:56.602065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:56.604137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:56.685972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 884/1765] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:02:56 2022] POST /identity/v3/users => generated 310 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:02:56.685972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:56.693480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:56.815999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04fb30-21f4-48ac-a5c5-c94bbc652507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:56.819752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04fb30-21f4-48ac-a5c5-c94bbc652507 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:56.820235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04fb30-21f4-48ac-a5c5-c94bbc652507 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:56.822118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04fb30-21f4-48ac-a5c5-c94bbc652507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:56.835026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9b04fb30-21f4-48ac-a5c5-c94bbc652507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:56.881633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99380c-a61c-4d62-a505-44f42e83f933 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:56.887987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:56.889743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:56.890466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:56.891626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:56.899673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:56.958037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:56.964716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:56.989212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 885/1766] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:56.992142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:56.996042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:57.035684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaba7d-2172-4b7c-9f24-032fbcdf106c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.057538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.058898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.059346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.062710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] PATH_INFO: `/v3/users/b9178b8239264546a39b900647a54225` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.067627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9178b8239264546a39b900647a54225)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.068907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04fb30-21f4-48ac-a5c5-c94bbc652507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.071272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04fb30-21f4-48ac-a5c5-c94bbc652507 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.073987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.106368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 882/1767] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 978 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:57.111383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ab795-bba3-463d-b1f1-25249bc85094 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.111827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ab795-bba3-463d-b1f1-25249bc85094 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.112880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ab795-bba3-463d-b1f1-25249bc85094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.163031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f84ab795-bba3-463d-b1f1-25249bc85094 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:57.164413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f84ab795-bba3-463d-b1f1-25249bc85094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:57.193189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 883/1768] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:57.193189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ab795-bba3-463d-b1f1-25249bc85094 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.205035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:57.220191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ab795-bba3-463d-b1f1-25249bc85094 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.234994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.237658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.238510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.239724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.242015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.246339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.278574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 884/1769] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:57.281103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.289270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:57.320498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8b3f-dd9d-4365-838c-4dc23d832629 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.333059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9178b8239264546a39b900647a54225'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:57.338157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.339797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.340601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.341862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.368224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.370315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.386446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9178b8239264546a39b900647a54225'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:57.394114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 885/1770] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:57.397006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.411549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9178b8239264546a39b900647a54225'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:57.415632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9178b8239264546a39b900647a54225'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:57.418060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9178b8239264546a39b900647a54225'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:02:57.430778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a516d-1dab-4831-a504-faa6f0c049bd service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.441206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:57.451918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.454095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.454375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.456529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] PATH_INFO: `/v3/projects/82cdab30921b426f8aa47cad1337d246/users/3a0c52799a93498d8d5b496c610f1704/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.465264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 886/1771] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:02:56 2022] DELETE /identity/v3/users/b9178b8239264546a39b900647a54225 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:57.500437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cdab30921b426f8aa47cad1337d246, user_id=3a0c52799a93498d8d5b496c610f1704, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.503725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.534875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 886/1772] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:57 2022] PUT /identity/v3/projects/82cdab30921b426f8aa47cad1337d246/users/3a0c52799a93498d8d5b496c610f1704/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:57.539574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:57.541569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:57.731087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576b1a8-81f7-4cdb-86ec-c6da2dd800e3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:57.936993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4fe0-5de0-4375-bf30-e06d1c1c4a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:57.939357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4fe0-5de0-4375-bf30-e06d1c1c4a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:57.940575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4fe0-5de0-4375-bf30-e06d1c1c4a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:57.941488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4fe0-5de0-4375-bf30-e06d1c1c4a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:57.943283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4fe0-5de0-4375-bf30-e06d1c1c4a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:57.951070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4fe0-5de0-4375-bf30-e06d1c1c4a3c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:57.987868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 887/1773] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:02:57.990224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:58.008658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b737-461b-4c12-82a0-83cfce0f2f39 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:58.023198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec12d3-6c06-40f0-8398-e8c7866e7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:58.026051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec12d3-6c06-40f0-8398-e8c7866e7406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:58.026343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec12d3-6c06-40f0-8398-e8c7866e7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:58.026621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec12d3-6c06-40f0-8398-e8c7866e7406 admin admin] PATH_INFO: `/v3/projects/82cdab30921b426f8aa47cad1337d246/users/3a0c52799a93498d8d5b496c610f1704/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:58.035028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec12d3-6c06-40f0-8398-e8c7866e7406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cdab30921b426f8aa47cad1337d246, user_id=3a0c52799a93498d8d5b496c610f1704, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:58.043831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec12d3-6c06-40f0-8398-e8c7866e7406 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:58.078018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:58.078327 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:58.078606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:58.092437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 887/1774] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:02:57 2022] PUT /identity/v3/projects/82cdab30921b426f8aa47cad1337d246/users/3a0c52799a93498d8d5b496c610f1704/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:02:58.107715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:58.108178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:58.108492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:58.159226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] MFA Rules not processed for user `b6b474e9ef2e49b3a27b73d8ffd385b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:58.160728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:58.196302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] MFA Rules not processed for user `3a0c52799a93498d8d5b496c610f1704`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:02:58.199012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:58.386281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 888/1775] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:58.452045 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 888/1776] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:02:58.466258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:58.468447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:58.552211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:58.554154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:58.630427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:58.719106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653138b-746b-4ac5-916f-34c3cc33e660 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:58.734780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:58.736782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:58.738311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:58.738604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:58.766056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844be40-9e19-4b22-87d4-589ac1b7e2f3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:58.775240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:58.775933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:58.776211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:58.776477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:58.796169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:58.799731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:58.805206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:58.809383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:58.817856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 889/1777] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:58.835799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 889/1778] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:59.448823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:59.462523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6fea-9438-4b9b-a1da-b4238226a5a9 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:59.479885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416deecd-9a5d-41eb-9079-3f1dc0c55e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:59.480559 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416deecd-9a5d-41eb-9079-3f1dc0c55e27 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:59.480902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416deecd-9a5d-41eb-9079-3f1dc0c55e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:59.481184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416deecd-9a5d-41eb-9079-3f1dc0c55e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:59.490310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-416deecd-9a5d-41eb-9079-3f1dc0c55e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:59.525587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:59.608484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:02:59.611155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:02:59.770172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416deecd-9a5d-41eb-9079-3f1dc0c55e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:59.792479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416deecd-9a5d-41eb-9079-3f1dc0c55e27 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:02:59.837676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 890/1779] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:02:59.931730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23da3d-e7c0-447e-8ec4-1167deec920c service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:02:59.950230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:02:59.952261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:02:59.952540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:02:59.952840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] PATH_INFO: `/v3/projects/638a4669a1aa43a88d5b8bc44a96ba2b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:02:59.956577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638a4669a1aa43a88d5b8bc44a96ba2b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:02:59.961460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:00.186153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638a4669a1aa43a88d5b8bc44a96ba2b', 'request_id': 'req-181245d5-041d-4451-9369-c1c340f21043'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:00.215758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638a4669a1aa43a88d5b8bc44a96ba2b', 'request_id': 'req-181245d5-041d-4451-9369-c1c340f21043'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:00.244406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638a4669a1aa43a88d5b8bc44a96ba2b', 'request_id': 'req-181245d5-041d-4451-9369-c1c340f21043'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:00.286447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] The token cache is being invalidate because project 638a4669a1aa43a88d5b8bc44a96ba2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:00.288771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:00.291313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-181245d5-041d-4451-9369-c1c340f21043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:00.301699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 890/1780] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:02:59 2022] DELETE /identity/v3/projects/638a4669a1aa43a88d5b8bc44a96ba2b => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:00.306658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc47d6-077f-41a5-bee8-077e61cdcae2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:00.306970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc47d6-077f-41a5-bee8-077e61cdcae2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:00.307222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc47d6-077f-41a5-bee8-077e61cdcae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:00.409649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-27dc47d6-077f-41a5-bee8-077e61cdcae2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:00.411090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-27dc47d6-077f-41a5-bee8-077e61cdcae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:00.747554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 891/1781] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:00.759426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa838-55f4-4dcc-8e35-395c3717cdae None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:00.760104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa838-55f4-4dcc-8e35-395c3717cdae None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:00.760104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa838-55f4-4dcc-8e35-395c3717cdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:00.837343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2c5aa838-55f4-4dcc-8e35-395c3717cdae None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:00.841675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c5aa838-55f4-4dcc-8e35-395c3717cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:00.899568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 891/1782] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:00.902675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc47d6-077f-41a5-bee8-077e61cdcae2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:00.944288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc47d6-077f-41a5-bee8-077e61cdcae2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.011448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.012430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.015291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.015922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.018097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:01.018606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.022596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.074642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 892/1783] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:01.079080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aa838-55f4-4dcc-8e35-395c3717cdae None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.108263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aa838-55f4-4dcc-8e35-395c3717cdae None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.133177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb17c75-e0b3-4e9a-8d99-634f04de959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.133899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb17c75-e0b3-4e9a-8d99-634f04de959e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.134372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb17c75-e0b3-4e9a-8d99-634f04de959e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.134710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb17c75-e0b3-4e9a-8d99-634f04de959e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.135664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb17c75-e0b3-4e9a-8d99-634f04de959e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.139385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb17c75-e0b3-4e9a-8d99-634f04de959e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.286157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 892/1784] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:01 2022] POST /identity/v3/projects => generated 401 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:01.290557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.316841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcde3a-6749-4ba8-9990-5ba2bf81063c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.538347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47158ad0-c3a0-419e-b251-afc863bc0d5d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.539125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47158ad0-c3a0-419e-b251-afc863bc0d5d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.540053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47158ad0-c3a0-419e-b251-afc863bc0d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.552489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.558007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.558007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.558271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.558860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.569515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.705099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-47158ad0-c3a0-419e-b251-afc863bc0d5d None None] MFA Rules not processed for user `5007fe05c96e468b9dbc9b22ff1e2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:01.707720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-47158ad0-c3a0-419e-b251-afc863bc0d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:01.763245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 893/1785] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:01 2022] POST /identity/v3/users => generated 301 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:01.766190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.798448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:01.821470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821435c-2fa6-44d7-90a9-4841c03c7edf admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:01.844829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 893/1786] 10.222.0.88 () {58 vars in 1015 bytes} [Tue Aug 30 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:01.851818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:01.852456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:01.852902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:01.856032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:01.858827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:01.862130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:01.901946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 894/1787] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:01.905901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47158ad0-c3a0-419e-b251-afc863bc0d5d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.950374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:01.971937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:01.981391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47158ad0-c3a0-419e-b251-afc863bc0d5d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.033650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.034467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.037179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.037589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.038548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.065977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.067387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de52b5-2766-4af8-aba9-630d513b539f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.072663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.073755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.074246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.074705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.087310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.089695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.102999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 895/1788] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:02.124832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 894/1789] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:02.125051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:02.148225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:02.196239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e01423-2ea8-41d0-8261-9a4fa1cb7d25 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.238185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571740d-ed29-49ec-8826-26bafc1227f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.246528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571740d-ed29-49ec-8826-26bafc1227f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.249627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571740d-ed29-49ec-8826-26bafc1227f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.253193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571740d-ed29-49ec-8826-26bafc1227f1 admin admin] PATH_INFO: `/v3/projects/9f3ca6aa268445f0877aad7868223cf6/users/822e50b440c84519bc441d34a01f93a2/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.322203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:02.324443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:02.356456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273aef8-d1e4-4e00-a72f-0ff2cee1d204 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:02.360832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571740d-ed29-49ec-8826-26bafc1227f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3ca6aa268445f0877aad7868223cf6, user_id=822e50b440c84519bc441d34a01f93a2, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.365955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571740d-ed29-49ec-8826-26bafc1227f1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.392787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:02.393478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.399013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.401767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] PATH_INFO: `/v3/projects/c402517007614c68b950d08229ea0e0c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.405787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c402517007614c68b950d08229ea0e0c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:02.430634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 896/1790] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:02 2022] PUT /identity/v3/projects/9f3ca6aa268445f0877aad7868223cf6/users/822e50b440c84519bc441d34a01f93a2/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:02.431782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:02.436008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34f43-e2f9-4934-a750-b032a32a8136 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:02.442720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34f43-e2f9-4934-a750-b032a32a8136 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:02.444227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc34f43-e2f9-4934-a750-b032a32a8136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:02.548176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bbc34f43-e2f9-4934-a750-b032a32a8136 None None] MFA Rules not processed for user `822e50b440c84519bc441d34a01f93a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:02.550760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bbc34f43-e2f9-4934-a750-b032a32a8136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:02.658288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c402517007614c68b950d08229ea0e0c', 'request_id': 'req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:02.688410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c402517007614c68b950d08229ea0e0c', 'request_id': 'req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:02.713101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c402517007614c68b950d08229ea0e0c', 'request_id': 'req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:02.774563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] The token cache is being invalidate because project c402517007614c68b950d08229ea0e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:02.774899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:02.776076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:02.779638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 895/1791] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:02 2022] DELETE /identity/v3/projects/c402517007614c68b950d08229ea0e0c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:02.785811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:02.788945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:02.818647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 897/1792] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:02.819855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc34f43-e2f9-4934-a750-b032a32a8136 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:03.085085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fb945-227c-4bd1-a0e5-4d3faaf2b280 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:03.100949 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:03.103159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:03.103676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:03.104197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] PATH_INFO: `/v3/users/0bb2c4e803984a528204367113314a5f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:03.106146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb2c4e803984a528204367113314a5f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:03.109650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:03.233250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc34f43-e2f9-4934-a750-b032a32a8136 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:03.263419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:03.266163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:03.266410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:03.268222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:03.270467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:03.273416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb2c4e803984a528204367113314a5f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:03.279455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:03.317655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb2c4e803984a528204367113314a5f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:03.329943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:03.346273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb2c4e803984a528204367113314a5f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:03.347790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb2c4e803984a528204367113314a5f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:03.349381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb2c4e803984a528204367113314a5f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:03.374205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 896/1793] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:02 2022] DELETE /identity/v3/users/0bb2c4e803984a528204367113314a5f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:03.408196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:03.408702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 898/1794] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:02 2022] POST /identity/v3/projects => generated 401 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:03.410336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:03.647448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf5d2f-6274-45b1-8909-e34f2664ab1e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:03.876490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:03.877152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:03.877428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:03.877692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:03.878335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:03.880300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:03.947808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 897/1795] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:03 2022] POST /identity/v3/users => generated 307 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:03.948088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:03.991583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520a5e6-a1a4-4525-a2a5-a1f0206ebfb5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:04.006807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:04.007527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:04.007811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:04.008089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:04.008853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:04.010634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:04.052745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 899/1796] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:04.058105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:04.080898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d681e-30fc-4b2f-a57a-d6306c6b0e1c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:04.096492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:04.097260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:04.097539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:04.097815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] PATH_INFO: `/v3/projects/2fd99fc990a64e2b976b43370fba7d0b/users/bede92e2e5a2494f9163a37e5110e17e/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:04.150380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd99fc990a64e2b976b43370fba7d0b, user_id=bede92e2e5a2494f9163a37e5110e17e, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:04.153237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:04.195620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 898/1797] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:04 2022] PUT /identity/v3/projects/2fd99fc990a64e2b976b43370fba7d0b/users/bede92e2e5a2494f9163a37e5110e17e/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:04.197303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:04.221097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424418-baac-436a-9da7-e3eaca3b4a31 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:04.383679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:04.435584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6c73-d95a-4869-923c-d5801db17302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:04.437387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6c73-d95a-4869-923c-d5801db17302 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:04.440210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6c73-d95a-4869-923c-d5801db17302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:04.440649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6c73-d95a-4869-923c-d5801db17302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:04.441588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6c73-d95a-4869-923c-d5801db17302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:04.462125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6c73-d95a-4869-923c-d5801db17302 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:04.490721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 900/1798] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:04.494736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:04.509412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2fbf-36d1-4657-86ab-b46174720770 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:04.518408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:04.519501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:04.519930 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:04.520413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] PATH_INFO: `/v3/projects/2fd99fc990a64e2b976b43370fba7d0b/users/bede92e2e5a2494f9163a37e5110e17e/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:04.533866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd99fc990a64e2b976b43370fba7d0b, user_id=bede92e2e5a2494f9163a37e5110e17e, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:04.541068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:04.570240 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 899/1799] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:04 2022] PUT /identity/v3/projects/2fd99fc990a64e2b976b43370fba7d0b/users/bede92e2e5a2494f9163a37e5110e17e/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:04.582189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92394fc-e90b-4a8e-aea5-423b04a1be13 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:04.582826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92394fc-e90b-4a8e-aea5-423b04a1be13 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:04.583291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92394fc-e90b-4a8e-aea5-423b04a1be13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:04.677884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a92394fc-e90b-4a8e-aea5-423b04a1be13 None None] MFA Rules not processed for user `bede92e2e5a2494f9163a37e5110e17e`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:04.684772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a92394fc-e90b-4a8e-aea5-423b04a1be13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:04.952969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 901/1800] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:04.977507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:04.980361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:05.104586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:05.175551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058b74f-3066-4480-be26-9de0557af0c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:05.191567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:05.194746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:05.198185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:05.199705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:05.229316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:05.231574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:05.276269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 900/1801] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:05.491100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92394fc-e90b-4a8e-aea5-423b04a1be13 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:05.506329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92394fc-e90b-4a8e-aea5-423b04a1be13 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:05.532586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac71d6-6f40-4a42-b406-aeb26fafe214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:05.533613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac71d6-6f40-4a42-b406-aeb26fafe214 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:05.534108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac71d6-6f40-4a42-b406-aeb26fafe214 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:05.534706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac71d6-6f40-4a42-b406-aeb26fafe214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:05.540894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a0ac71d6-6f40-4a42-b406-aeb26fafe214 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:05.899679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac71d6-6f40-4a42-b406-aeb26fafe214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:05.902310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac71d6-6f40-4a42-b406-aeb26fafe214 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:05.993985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 902/1802] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:05 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:07.295463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:07.298435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:07.530122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31cd10-e7f0-4d96-b8c8-0701d4ccd24c service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:07.556102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:07.556786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:07.557092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:07.557444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] PATH_INFO: `/v3/projects/3082f9d17a4b49e0a131af0f3fc3f353` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:07.571200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3082f9d17a4b49e0a131af0f3fc3f353)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:07.585094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:07.709566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938f27f-dc60-4614-b364-d8518f28ce8a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:07.710069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938f27f-dc60-4614-b364-d8518f28ce8a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:07.710069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938f27f-dc60-4614-b364-d8518f28ce8a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:07.712200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 903/1803] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:03:07.772985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3082f9d17a4b49e0a131af0f3fc3f353', 'request_id': 'req-d2d775ee-a487-4f72-95b7-232efcd3024e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:07.794154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3082f9d17a4b49e0a131af0f3fc3f353', 'request_id': 'req-d2d775ee-a487-4f72-95b7-232efcd3024e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:07.828787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3082f9d17a4b49e0a131af0f3fc3f353', 'request_id': 'req-d2d775ee-a487-4f72-95b7-232efcd3024e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:07.870795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d9656-96ab-494a-9ad7-cbdbd635856e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:07.871114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] The token cache is being invalidate because project 3082f9d17a4b49e0a131af0f3fc3f353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:07.871416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:07.871862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d9656-96ab-494a-9ad7-cbdbd635856e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:07.872416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d9656-96ab-494a-9ad7-cbdbd635856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:07.875147 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2d775ee-a487-4f72-95b7-232efcd3024e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:07.879587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 901/1804] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:07 2022] DELETE /identity/v3/projects/3082f9d17a4b49e0a131af0f3fc3f353 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:07.885017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64cad7-9e82-4916-b42c-b3a416005e8c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:07.886108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64cad7-9e82-4916-b42c-b3a416005e8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:07.886456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64cad7-9e82-4916-b42c-b3a416005e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:07.931130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8b8d9656-96ab-494a-9ad7-cbdbd635856e None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:07.934710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8b8d9656-96ab-494a-9ad7-cbdbd635856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:07.944564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9d64cad7-9e82-4916-b42c-b3a416005e8c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:07.948038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d64cad7-9e82-4916-b42c-b3a416005e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:08.149717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:08.154377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 902/1805] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:08.157119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a865bd-c22e-4171-b344-d9264e4523ea None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.157415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a865bd-c22e-4171-b344-d9264e4523ea None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.161925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a865bd-c22e-4171-b344-d9264e4523ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.183267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 904/1806] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:03:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:08.221470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-64a865bd-c22e-4171-b344-d9264e4523ea None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:08.222761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-64a865bd-c22e-4171-b344-d9264e4523ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:08.246846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 903/1807] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:08.251705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d9656-96ab-494a-9ad7-cbdbd635856e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.270115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d9656-96ab-494a-9ad7-cbdbd635856e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.293253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ea43-df47-44d4-beb5-f4983addf3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.294468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ea43-df47-44d4-beb5-f4983addf3be admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.297165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ea43-df47-44d4-beb5-f4983addf3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.298285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ea43-df47-44d4-beb5-f4983addf3be admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.299621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ea43-df47-44d4-beb5-f4983addf3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:08.302763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ea43-df47-44d4-beb5-f4983addf3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.306295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ea43-df47-44d4-beb5-f4983addf3be admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.366128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a865bd-c22e-4171-b344-d9264e4523ea None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.366789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 905/1808] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:08.375319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:08.384751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a865bd-c22e-4171-b344-d9264e4523ea None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.414879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.415786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.416220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.416652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.417715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.418984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.419397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.419673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.429355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.482710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] MFA Rules not processed for user `e2b354bfe62742e3bce1b8ec7eb85e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:08.487021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:08.560702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 904/1809] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:08 2022] POST /identity/v3/projects => generated 357 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:08.564652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.650356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 906/1810] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:08.651558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.653170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:08.688314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ea797-690d-40f2-b966-df9b4e25d50f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.781999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf13a1-4dd3-472c-8b12-72fb7be5b538 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.795172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.795933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.796310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.796679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.797845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.800076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.856200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 905/1811] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:08 2022] POST /identity/v3/users => generated 279 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:08.867777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.888469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cc604-9d9d-4159-9601-bd0321483c7e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.893061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.894132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.894966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.895782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.899399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:08.901875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:08.902256 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:08.902632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:08.906104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.907884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.914984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:08.917067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:08.940590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 906/1812] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:08.941740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.954532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:08.962430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 907/1813] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:08.963509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:08.981283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eefe79-93bd-4de9-b1e9-e884f5596e72 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.986021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4405d-0def-4a04-8d40-36486fc817ab service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:08.999107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.001194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.001842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.002776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.003282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] PATH_INFO: `/v3/users/9d1a51debe33474a9610956f777f5670` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.004785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.006913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.007390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.008433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.008754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1a51debe33474a9610956f777f5670)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.013370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.014610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.075771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 908/1814] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:09.077047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:09.104830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff104a-25ef-413e-a6a9-5e90defdb7f1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:09.121293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479414a-60fb-48f3-bb38-d0ce077bc69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.122408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479414a-60fb-48f3-bb38-d0ce077bc69d admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.123061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479414a-60fb-48f3-bb38-d0ce077bc69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.123575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479414a-60fb-48f3-bb38-d0ce077bc69d admin admin] PATH_INFO: `/v3/projects/6e743ec22587462a9328b5f044455c3f/users/aa49bceec83941d69a89a60f80223c96/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.183417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479414a-60fb-48f3-bb38-d0ce077bc69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e743ec22587462a9328b5f044455c3f, user_id=aa49bceec83941d69a89a60f80223c96, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.186839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1a51debe33474a9610956f777f5670'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:09.197102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479414a-60fb-48f3-bb38-d0ce077bc69d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.219886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1a51debe33474a9610956f777f5670'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:09.237857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 909/1815] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:09 2022] PUT /identity/v3/projects/6e743ec22587462a9328b5f044455c3f/users/aa49bceec83941d69a89a60f80223c96/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:09.242621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1a51debe33474a9610956f777f5670'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:09.244000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1a51debe33474a9610956f777f5670'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:09.245349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4892945-423f-49eb-abba-26f24ec6a1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1a51debe33474a9610956f777f5670'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:09.256601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.258363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.258656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.306900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 907/1816] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:08 2022] DELETE /identity/v3/users/9d1a51debe33474a9610956f777f5670 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:09.311011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.312111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.312397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.346390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] MFA Rules not processed for user `aa49bceec83941d69a89a60f80223c96`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:09.349396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:09.376312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:09.377581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:09.410856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.434801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.495665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 910/1817] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:09.497218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:09.500863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:09.581167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 908/1818] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:09.629029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:09.631413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:09.666798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48076ec1-1093-4594-a9ff-5eb050e66305 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:09.682960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.683823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.683823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.684672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.685204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.688836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.761902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 911/1819] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:09 2022] POST /identity/v3/projects => generated 353 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:09.763483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:09.801819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8a74-4806-472a-aa22-5a1284ef50b4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:09.909669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8ec2d-3954-4383-bcf4-3a33a2240d41 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:09.915882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.916598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.916860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.917137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.917781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.920250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.953443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 912/1820] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:09 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:09.953559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.954320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.954464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:09.954669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.954861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.968845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca9a02-f6a8-44f3-a6ea-7ab8cf9f75ec admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:09.974711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:09.974898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.975362 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:09.975638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:09.975916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:09.976479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.976898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:09.978620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:09.999617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 909/1821] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:03:10.005022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 913/1822] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:10.011284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:10.026872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed075af-d023-4601-8cb1-cdedce362e1b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:10.032125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:10.032857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:10.033153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:10.033424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] PATH_INFO: `/v3/projects/18696c5963a84045a895c0e6863b28c0/users/cd637e3805cc485496bcf3989a43a23a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:10.055836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=18696c5963a84045a895c0e6863b28c0, user_id=cd637e3805cc485496bcf3989a43a23a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:10.060121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:10.091169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 910/1823] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:10 2022] PUT /identity/v3/projects/18696c5963a84045a895c0e6863b28c0/users/cd637e3805cc485496bcf3989a43a23a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:10.096052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:10.112923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fd930-b6f6-4acd-89a5-e1fbdec5b13f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:10.188883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:10.241941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711af76-bf3d-47f0-b8da-e5ed20c4f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:10.243537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711af76-bf3d-47f0-b8da-e5ed20c4f4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:10.243995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711af76-bf3d-47f0-b8da-e5ed20c4f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:10.244707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711af76-bf3d-47f0-b8da-e5ed20c4f4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:10.245944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711af76-bf3d-47f0-b8da-e5ed20c4f4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:10.248863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711af76-bf3d-47f0-b8da-e5ed20c4f4c5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:10.261560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 914/1824] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:10.266651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:10.281093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc0969-b807-43bc-b23d-843253c53ddd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:10.286417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18425988-6764-4ab3-84c4-c7136cb322e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:10.287116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18425988-6764-4ab3-84c4-c7136cb322e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:10.287391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18425988-6764-4ab3-84c4-c7136cb322e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:10.287665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18425988-6764-4ab3-84c4-c7136cb322e0 admin admin] PATH_INFO: `/v3/projects/18696c5963a84045a895c0e6863b28c0/users/cd637e3805cc485496bcf3989a43a23a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:10.290248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18425988-6764-4ab3-84c4-c7136cb322e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18696c5963a84045a895c0e6863b28c0, user_id=cd637e3805cc485496bcf3989a43a23a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:10.295619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18425988-6764-4ab3-84c4-c7136cb322e0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:10.317106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 911/1825] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:10 2022] PUT /identity/v3/projects/18696c5963a84045a895c0e6863b28c0/users/cd637e3805cc485496bcf3989a43a23a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:10.329804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:10.330048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:10.330338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:10.374198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] MFA Rules not processed for user `cd637e3805cc485496bcf3989a43a23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:10.374198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:10.471349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057be5c-7e3a-49e6-8964-4fff1ea11d37 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:10.471888 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057be5c-7e3a-49e6-8964-4fff1ea11d37 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:10.471888 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057be5c-7e3a-49e6-8964-4fff1ea11d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:10.510225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2057be5c-7e3a-49e6-8964-4fff1ea11d37 None None] MFA Rules not processed for user `ec329f81679e4ffa83174d621b4440d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:10.511549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2057be5c-7e3a-49e6-8964-4fff1ea11d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:10.535002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 915/1826] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:10.548984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:10.551913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:10.654285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:10.669514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 912/1827] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:10.728836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e76c0c-b3a8-4617-b48b-795f833c5a0c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:10.736538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495a8b-b7fa-4e6e-a0fb-018f1c64376c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:10.737426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495a8b-b7fa-4e6e-a0fb-018f1c64376c service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:10.737736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495a8b-b7fa-4e6e-a0fb-018f1c64376c service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:10.738135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495a8b-b7fa-4e6e-a0fb-018f1c64376c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:10.772642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495a8b-b7fa-4e6e-a0fb-018f1c64376c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:10.774573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495a8b-b7fa-4e6e-a0fb-018f1c64376c service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:10.786627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 916/1828] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:10.936057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057be5c-7e3a-49e6-8964-4fff1ea11d37 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:10.949137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057be5c-7e3a-49e6-8964-4fff1ea11d37 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:10.959214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9f793-8385-43f2-a937-b270f9835e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:10.960249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9f793-8385-43f2-a937-b270f9835e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:10.960609 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9f793-8385-43f2-a937-b270f9835e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:10.961105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9f793-8385-43f2-a937-b270f9835e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:11.054638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf793-395a-451c-84e9-b5780829551d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:11.055355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf793-395a-451c-84e9-b5780829551d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:11.055355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf793-395a-451c-84e9-b5780829551d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:11.057275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 917/1829] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:03:11.083163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:11.084507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:11.085654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:11.110020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9f793-8385-43f2-a937-b270f9835e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:11.113587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9f793-8385-43f2-a937-b270f9835e24 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:11.134744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 913/1830] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:11.165926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:11.167548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:11.299999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:11.409287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 918/1831] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:11.475071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:11.475659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:11.475659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:11.551251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] MFA Rules not processed for user `b6b474e9ef2e49b3a27b73d8ffd385b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:11.564167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:11.762037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 914/1832] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:11.834267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:11.836928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:11.955163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88024e32-0975-4fc6-ab0d-6f123c0f9fc8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:11.965205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:11.965714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:11.966086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:11.966392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] PATH_INFO: `/v3/users/822e50b440c84519bc441d34a01f93a2` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:11.967667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822e50b440c84519bc441d34a01f93a2)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:11.970186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:11.995593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:11.997839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:12.031373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60264-24ad-447c-a2f6-4f39a184b4d1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.032893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822e50b440c84519bc441d34a01f93a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.041405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822e50b440c84519bc441d34a01f93a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.045909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd25614-b611-4ac9-9b9f-7421c10ff3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.047287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd25614-b611-4ac9-9b9f-7421c10ff3f5 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.047780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd25614-b611-4ac9-9b9f-7421c10ff3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.048130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd25614-b611-4ac9-9b9f-7421c10ff3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.051947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822e50b440c84519bc441d34a01f93a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.053659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822e50b440c84519bc441d34a01f93a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.063328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd25614-b611-4ac9-9b9f-7421c10ff3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:12.065804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd25614-b611-4ac9-9b9f-7421c10ff3f5 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:12.078023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822e50b440c84519bc441d34a01f93a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.085693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 915/1833] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:12.103739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 919/1834] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:11 2022] DELETE /identity/v3/users/822e50b440c84519bc441d34a01f93a2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:12.106060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.106531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.107467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.138566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:12.139957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:12.231429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 916/1835] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:12.245476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:12.247304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:12.253844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:12.255445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:12.274176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2080d-49ac-423e-8f2d-dd7cfe4f5a85 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.288473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.290259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.290589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.290913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] PATH_INFO: `/v3/projects/5ced8a48a562478487cb364693a2584e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.292249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ced8a48a562478487cb364693a2584e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:12.295456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:12.376474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:12.403815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615bde0-ac81-4818-b861-15b37a6fb930 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.416468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ced8a48a562478487cb364693a2584e', 'request_id': 'req-a98f3dc3-418a-4452-bf6a-0c6f0859de28'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.431646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ced8a48a562478487cb364693a2584e', 'request_id': 'req-a98f3dc3-418a-4452-bf6a-0c6f0859de28'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.444627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:12.449433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ced8a48a562478487cb364693a2584e', 'request_id': 'req-a98f3dc3-418a-4452-bf6a-0c6f0859de28'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.499713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] The token cache is being invalidate because project 5ced8a48a562478487cb364693a2584e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:12.500413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.500681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.503089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 917/1836] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:12 2022] DELETE /identity/v3/projects/5ced8a48a562478487cb364693a2584e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:12.507391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:12.508840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:12.514324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.515312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.515798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.516260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.520384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:12.650577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:12.652334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:12.667459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 920/1837] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:12.673643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f3dc3-418a-4452-bf6a-0c6f0859de28 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:12.686290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:12.687824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:12.689625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:12.690503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] PATH_INFO: `/v3/users/3a0c52799a93498d8d5b496c610f1704` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:12.698784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0c52799a93498d8d5b496c610f1704)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:12.701874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:12.789250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0c52799a93498d8d5b496c610f1704'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.822905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0c52799a93498d8d5b496c610f1704'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.842219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0c52799a93498d8d5b496c610f1704'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.844089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0c52799a93498d8d5b496c610f1704'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.846142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0c52799a93498d8d5b496c610f1704'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:12.878436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 918/1838] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:12 2022] DELETE /identity/v3/users/3a0c52799a93498d8d5b496c610f1704 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:13.456142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:13.458329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:13.488968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84bce7-8d63-4332-9d67-79f07c3f133c service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:13.568269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:13.569258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:13.569670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:13.569874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] PATH_INFO: `/v3/projects/9f3ca6aa268445f0877aad7868223cf6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.571273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3ca6aa268445f0877aad7868223cf6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:13.573380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:13.639391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3ca6aa268445f0877aad7868223cf6', 'request_id': 'req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.649122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3ca6aa268445f0877aad7868223cf6', 'request_id': 'req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.651634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:13.653586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:13.670540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaeb9d-7c68-45c9-86f0-7282eee612aa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:13.679789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3ca6aa268445f0877aad7868223cf6', 'request_id': 'req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.692500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:13.697764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] The token cache is being invalidate because project 9f3ca6aa268445f0877aad7868223cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:13.698055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.698731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.700839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 921/1839] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:13 2022] DELETE /identity/v3/projects/9f3ca6aa268445f0877aad7868223cf6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:13.704950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:13.706962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:13.719734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:13.759117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:13.759483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:13.759850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:13.760262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] PATH_INFO: `/v3/projects/82cdab30921b426f8aa47cad1337d246` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.761418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cdab30921b426f8aa47cad1337d246)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:13.763411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:13.790745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aa7fc-cdd4-4d5b-941d-dc0b3fb54bbb admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:13.797041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:13.797903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:13.798186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:13.798360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] PATH_INFO: `/v3/users/bede92e2e5a2494f9163a37e5110e17e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.799518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bede92e2e5a2494f9163a37e5110e17e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:13.801754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:13.821021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cdab30921b426f8aa47cad1337d246', 'request_id': 'req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.829542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cdab30921b426f8aa47cad1337d246', 'request_id': 'req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.840374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cdab30921b426f8aa47cad1337d246', 'request_id': 'req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.858916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] The token cache is being invalidate because project 82cdab30921b426f8aa47cad1337d246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:13.859683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.860503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee55f8b6-7dd1-41c1-bb85-f405425b04d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.862670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 919/1840] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:13 2022] DELETE /identity/v3/projects/82cdab30921b426f8aa47cad1337d246 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:13.862795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bede92e2e5a2494f9163a37e5110e17e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.868021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ce9d6-9c16-4b57-914f-9d716b9e7380 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:13.868419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ce9d6-9c16-4b57-914f-9d716b9e7380 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:13.868793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ce9d6-9c16-4b57-914f-9d716b9e7380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:13.872607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bede92e2e5a2494f9163a37e5110e17e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.882317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bede92e2e5a2494f9163a37e5110e17e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.883143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bede92e2e5a2494f9163a37e5110e17e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.896456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-356ce9d6-9c16-4b57-914f-9d716b9e7380 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:13.898585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3d7ff12e-c7dc-4733-bfe2-009e45b90b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bede92e2e5a2494f9163a37e5110e17e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:13.899072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-356ce9d6-9c16-4b57-914f-9d716b9e7380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:13.909606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 922/1841] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:13 2022] DELETE /identity/v3/users/bede92e2e5a2494f9163a37e5110e17e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:14.026044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 920/1842] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:14.027593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbacc19-42ba-4f00-836f-f75cee9d1a9b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.027940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbacc19-42ba-4f00-836f-f75cee9d1a9b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.028308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbacc19-42ba-4f00-836f-f75cee9d1a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.066648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4bbacc19-42ba-4f00-836f-f75cee9d1a9b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:14.067894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4bbacc19-42ba-4f00-836f-f75cee9d1a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:14.158319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 923/1843] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:14.159868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ce9d6-9c16-4b57-914f-9d716b9e7380 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.170550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ce9d6-9c16-4b57-914f-9d716b9e7380 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.176130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.176753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.177069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.177344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.178014 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:14.178319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.180033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.202308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 921/1844] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:14.207666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbacc19-42ba-4f00-836f-f75cee9d1a9b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.225412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbacc19-42ba-4f00-836f-f75cee9d1a9b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.231232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.232329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.232653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.232994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.233674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.237508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.268575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:14.299508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.310959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 924/1845] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:14 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:14.323623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14bbc8-6cf1-499e-9de1-604213f83e47 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.469221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:14.494346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.495171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.495626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.496090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.496964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.499830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.537574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 922/1846] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:14 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:14.540120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.557304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945915b-d169-40da-b32c-9ca093ceedcd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.566343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.567447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.569166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.569611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.571486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.577865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.609660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 925/1847] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:14.614049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.653699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695f57-f0b3-43af-abab-f2719587b1b9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.672548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930efe51-9e1e-4e60-90d5-d0c6abc4731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.676181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930efe51-9e1e-4e60-90d5-d0c6abc4731f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.688909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930efe51-9e1e-4e60-90d5-d0c6abc4731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.688909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930efe51-9e1e-4e60-90d5-d0c6abc4731f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.688909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930efe51-9e1e-4e60-90d5-d0c6abc4731f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.688909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930efe51-9e1e-4e60-90d5-d0c6abc4731f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.717013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:14.717476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 923/1848] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:14.738327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec6f7-1116-487c-9ffd-d6fd80120e01 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:14.760888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:14.762075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.762392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.762795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] PATH_INFO: `/v3/projects/8103a7bc6d8c4f9f822e8348a432e307/users/14c24a4753f74beda18d0bab7abb62ac/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.792984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8103a7bc6d8c4f9f822e8348a432e307, user_id=14c24a4753f74beda18d0bab7abb62ac, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:14.796610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:14.831464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:14.831931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:14.832309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:14.832467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 926/1849] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:14 2022] PUT /identity/v3/projects/8103a7bc6d8c4f9f822e8348a432e307/users/14c24a4753f74beda18d0bab7abb62ac/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:14.898251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] MFA Rules not processed for user `14c24a4753f74beda18d0bab7abb62ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:14.899680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:15.003896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 924/1850] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:15.010474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.115019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.116722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:15.133545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d438042-3717-40a0-a004-072d128bc81a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.140372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.141146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.141266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615a12-2958-4d82-b56d-e435bfa1be28 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.141604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.142067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.142920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.146201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.146877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.147152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.147422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] PATH_INFO: `/v3/projects/2fd99fc990a64e2b976b43370fba7d0b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.148606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd99fc990a64e2b976b43370fba7d0b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.150623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.156017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.193632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 927/1851] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:15.197742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.249699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd99fc990a64e2b976b43370fba7d0b', 'request_id': 'req-4af148d7-8b0c-48a4-b534-2cc06ebb4129'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:15.259175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd99fc990a64e2b976b43370fba7d0b', 'request_id': 'req-4af148d7-8b0c-48a4-b534-2cc06ebb4129'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:15.268495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd99fc990a64e2b976b43370fba7d0b', 'request_id': 'req-4af148d7-8b0c-48a4-b534-2cc06ebb4129'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:15.288637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] The token cache is being invalidate because project 2fd99fc990a64e2b976b43370fba7d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:15.289036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:15.290336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4af148d7-8b0c-48a4-b534-2cc06ebb4129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:15.292094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 925/1852] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:15 2022] DELETE /identity/v3/projects/2fd99fc990a64e2b976b43370fba7d0b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:15.297899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27dea-65fd-48d8-9424-e51b2ae304f8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.298184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27dea-65fd-48d8-9424-e51b2ae304f8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.298553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e27dea-65fd-48d8-9424-e51b2ae304f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.318653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67595f-ee6d-4228-add5-fd8dba420321 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.326163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-38e27dea-65fd-48d8-9424-e51b2ae304f8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:15.327815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-38e27dea-65fd-48d8-9424-e51b2ae304f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:15.380345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:15.383917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:15.394563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.395340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.395757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.396027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.397135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.399100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.411716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 926/1853] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:15.420898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ca7e2-9716-423e-810a-c4a7fc9a99e2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.421349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ca7e2-9716-423e-810a-c4a7fc9a99e2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.421723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ca7e2-9716-423e-810a-c4a7fc9a99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.429054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 928/1854] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:15.430333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.432531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:15.444632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4c6ca7e2-9716-423e-810a-c4a7fc9a99e2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:15.444979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532cb09-ce27-4f9b-9922-bcfe8dec569c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.446177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4c6ca7e2-9716-423e-810a-c4a7fc9a99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:15.450227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.450899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.451271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.451547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.452197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.453858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.456041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 927/1855] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:15.460353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ca7e2-9716-423e-810a-c4a7fc9a99e2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.468515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 929/1856] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:15.473491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.474126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ca7e2-9716-423e-810a-c4a7fc9a99e2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.478982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.479684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.480030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.480374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.481187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:15.481755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.484699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.485504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3c3ba-da29-4527-9039-3ba802f8ba1a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.491957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.492836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.492986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.493264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] PATH_INFO: `/v3/projects/6ba5a787991c48a6aa6ab6334792ce86/users/5b30cb73a7bf4e2e96fb0165413dc51b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.498973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 928/1857] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:15.503617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.515159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba5a787991c48a6aa6ab6334792ce86, user_id=5b30cb73a7bf4e2e96fb0165413dc51b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.515875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e7d55-8908-472b-a4ed-2c08ec52980f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.519743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.520906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.521724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.522069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.522430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.523366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.525454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.538754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 930/1858] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:15 2022] PUT /identity/v3/projects/6ba5a787991c48a6aa6ab6334792ce86/users/5b30cb73a7bf4e2e96fb0165413dc51b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:15.542732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.565776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 929/1859] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:15.570255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.630688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd39b-eddd-4541-879b-b2e7a8084bc4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.664282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66dcb7-49d0-41a7-aba9-915b94f60635 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.669118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.669744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.670023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.670295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.671031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.673165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.705965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 930/1860] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:15.712631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.729322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe03d8-9a4a-412c-b8f9-c6f5924ee822 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.738880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.739905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.740315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.740586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.741439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.743149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.745372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.746075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.746424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.746764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.747554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.749773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.762691 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 931/1861] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:15.766972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.773265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 931/1862] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:15.776034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.780349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc7ee7-11a7-48b9-9c62-823112a98258 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.785830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965ca25-4e6d-4e4d-856e-36c782cbecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.786503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965ca25-4e6d-4e4d-856e-36c782cbecb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.786783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965ca25-4e6d-4e4d-856e-36c782cbecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.787072 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965ca25-4e6d-4e4d-856e-36c782cbecb0 admin admin] PATH_INFO: `/v3/projects/6ba5a787991c48a6aa6ab6334792ce86/users/5b30cb73a7bf4e2e96fb0165413dc51b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.788674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a21c6-76f5-4208-bc95-64aaf1ac1e4c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.789974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965ca25-4e6d-4e4d-856e-36c782cbecb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba5a787991c48a6aa6ab6334792ce86, user_id=5b30cb73a7bf4e2e96fb0165413dc51b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.792642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965ca25-4e6d-4e4d-856e-36c782cbecb0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.796333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.796988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.797264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.797570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.798411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.800164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.804790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 932/1863] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:15 2022] PUT /identity/v3/projects/6ba5a787991c48a6aa6ab6334792ce86/users/5b30cb73a7bf4e2e96fb0165413dc51b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:15.818458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369519e9-7869-4f97-b4bf-1168546c3373 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.818745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369519e9-7869-4f97-b4bf-1168546c3373 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.819021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369519e9-7869-4f97-b4bf-1168546c3373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.821209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 932/1864] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:15.825746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:15.840223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62eb594-dd6c-4c2a-b41f-3a835f3f8c68 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:15.856761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-369519e9-7869-4f97-b4bf-1168546c3373 None None] MFA Rules not processed for user `5b30cb73a7bf4e2e96fb0165413dc51b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:15.858364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-369519e9-7869-4f97-b4bf-1168546c3373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:15.923717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:15.926479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:15.927030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.927322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.927597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] PATH_INFO: `/v3/projects/72329375f58e4879b0ae0e3e2458583d/users/453638224f5143c09082e3769815b3ae/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:15.953336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:15.957796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72329375f58e4879b0ae0e3e2458583d, user_id=453638224f5143c09082e3769815b3ae, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:15.961927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:15.992879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 933/1866] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:15.993074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 933/1866] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:15 2022] PUT /identity/v3/projects/72329375f58e4879b0ae0e3e2458583d/users/453638224f5143c09082e3769815b3ae/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:15.997475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f340-f25c-4511-bc18-644d577a44db None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:15.997762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f340-f25c-4511-bc18-644d577a44db None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:15.998029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f340-f25c-4511-bc18-644d577a44db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.005067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.006804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:16.030412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0ed7f340-f25c-4511-bc18-644d577a44db None None] MFA Rules not processed for user `453638224f5143c09082e3769815b3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:16.031689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0ed7f340-f25c-4511-bc18-644d577a44db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:16.087548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a70eb-7e06-49d8-a1ec-8818489de8f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.095173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.096445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.097791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.097791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.102373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:16.119560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 934/1867] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:16.125762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f340-f25c-4511-bc18-644d577a44db None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.215339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.217987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.228101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f340-f25c-4511-bc18-644d577a44db None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.232350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 934/1868] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:16.235367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.236127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.236475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.236838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.237634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.239838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.274557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 935/1869] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:16 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:16.278972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.293367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c11f6e-942f-4a3d-b998-8e6fc870e00d service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.395788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.396446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.396748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.397186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.397854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.399804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.424842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 935/1870] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:16 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:16.428911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.440970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff095-cc73-4ebf-bd8f-9f1a64f95527 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.446112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.446721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.446992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.447272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.448025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.450486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.464832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 936/1871] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:16.468482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.479250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ee9e-f617-4f2e-81f0-4afb9516642d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.485210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.485874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.486218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.486498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] PATH_INFO: `/v3/projects/3f861494b4ef40228490d1f897b99158/users/a7579a4d8d6943ee98d09ba24e596070/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.503449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f861494b4ef40228490d1f897b99158, user_id=a7579a4d8d6943ee98d09ba24e596070, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.506434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.524031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 936/1872] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:16 2022] PUT /identity/v3/projects/3f861494b4ef40228490d1f897b99158/users/a7579a4d8d6943ee98d09ba24e596070/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:16.528454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.538523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee9e2-d621-4261-a3b6-682b9f1857be admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.567291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:16.603381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349396d-c606-465a-be74-dc12073a9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.604024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349396d-c606-465a-be74-dc12073a9437 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.604307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349396d-c606-465a-be74-dc12073a9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.604579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349396d-c606-465a-be74-dc12073a9437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.605278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349396d-c606-465a-be74-dc12073a9437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.607316 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349396d-c606-465a-be74-dc12073a9437 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.619134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 937/1873] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:16.623991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.635283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1f36f-54c4-412b-9437-60ada451142f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.642805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.643811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.644303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.644614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] PATH_INFO: `/v3/projects/3f861494b4ef40228490d1f897b99158/users/a7579a4d8d6943ee98d09ba24e596070/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.656500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f861494b4ef40228490d1f897b99158, user_id=a7579a4d8d6943ee98d09ba24e596070, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.665812 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.675002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:16.691104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 937/1874] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:16 2022] PUT /identity/v3/projects/3f861494b4ef40228490d1f897b99158/users/a7579a4d8d6943ee98d09ba24e596070/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:16.703151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43035b-a6d5-4974-9283-e5a412d4c8b9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.703455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43035b-a6d5-4974-9283-e5a412d4c8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.703719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43035b-a6d5-4974-9283-e5a412d4c8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.757836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0c43035b-a6d5-4974-9283-e5a412d4c8b9 None None] MFA Rules not processed for user `a7579a4d8d6943ee98d09ba24e596070`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:16.760642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0c43035b-a6d5-4974-9283-e5a412d4c8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:16.873247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 938/1875] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:16.885047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:16.958585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcdcf3-aa92-4ad0-b142-17095dc12749 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:16.962626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fca3e-b1c1-4153-b8db-1a4e75b8cdbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:16.963234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fca3e-b1c1-4153-b8db-1a4e75b8cdbc service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:16.963508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fca3e-b1c1-4153-b8db-1a4e75b8cdbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:16.964037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fca3e-b1c1-4153-b8db-1a4e75b8cdbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:16.983825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fca3e-b1c1-4153-b8db-1a4e75b8cdbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:16.985827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fca3e-b1c1-4153-b8db-1a4e75b8cdbc service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:16.997535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 938/1876] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:17.548010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43035b-a6d5-4974-9283-e5a412d4c8b9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:17.631859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43035b-a6d5-4974-9283-e5a412d4c8b9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:17.636621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:17.637352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:17.637891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:17.638020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] PATH_INFO: `/v3/users/453638224f5143c09082e3769815b3ae` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:17.639335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453638224f5143c09082e3769815b3ae)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:17.641860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:17.732086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453638224f5143c09082e3769815b3ae'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:17.741760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:17.773104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453638224f5143c09082e3769815b3ae'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:17.792583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453638224f5143c09082e3769815b3ae'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:17.794330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453638224f5143c09082e3769815b3ae'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:17.829482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453638224f5143c09082e3769815b3ae'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:17.841331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 939/1877] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:17 2022] DELETE /identity/v3/users/453638224f5143c09082e3769815b3ae => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:17.846771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4267-3eeb-480f-8174-adfa584511cd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:17.848929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4267-3eeb-480f-8174-adfa584511cd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:17.849257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4267-3eeb-480f-8174-adfa584511cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:17.880410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b16b4267-3eeb-480f-8174-adfa584511cd None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:17.881835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b16b4267-3eeb-480f-8174-adfa584511cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:17.976942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 939/1878] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:17.987718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:17.989573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:18.084755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776f92-2d62-4308-9e8a-e95bee02c3b0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:18.088927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab14fa-a2e5-40bf-b7e7-bb41c4861e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:18.089617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab14fa-a2e5-40bf-b7e7-bb41c4861e4d service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:18.090326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab14fa-a2e5-40bf-b7e7-bb41c4861e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:18.090326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab14fa-a2e5-40bf-b7e7-bb41c4861e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:18.100137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab14fa-a2e5-40bf-b7e7-bb41c4861e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:18.101714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab14fa-a2e5-40bf-b7e7-bb41c4861e4d service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:18.113294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 940/1879] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:19.199529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c86b4-5428-467f-b0cc-4a48f1ba11c2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:19.200146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c86b4-5428-467f-b0cc-4a48f1ba11c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:19.200374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c86b4-5428-467f-b0cc-4a48f1ba11c2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:19.202885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 940/1880] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:03:19.211608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:19.212066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:19.212142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:19.253215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:19.254819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:19.390553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 941/1881] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:19.411924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c86b4-5428-467f-b0cc-4a48f1ba11c2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:19.414237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0b1c86b4-5428-467f-b0cc-4a48f1ba11c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:19.448934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c86b4-5428-467f-b0cc-4a48f1ba11c2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:19.464553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:19.465544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:19.467414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:19.467956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:19.491014 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:19.498446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:19.527750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 941/1882] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:19.649781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:19.656564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:19.679269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acf1d2-5c6e-4315-80c1-5f6839ddf383 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:19.691728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:19.692423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:19.692716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:19.693043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] PATH_INFO: `/v3/projects/72329375f58e4879b0ae0e3e2458583d` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:19.696705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72329375f58e4879b0ae0e3e2458583d)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:19.698685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:19.795749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72329375f58e4879b0ae0e3e2458583d', 'request_id': 'req-8fbb588f-182d-440e-9fce-5599d7e20536'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:19.812526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72329375f58e4879b0ae0e3e2458583d', 'request_id': 'req-8fbb588f-182d-440e-9fce-5599d7e20536'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:19.815621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:19.830800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72329375f58e4879b0ae0e3e2458583d', 'request_id': 'req-8fbb588f-182d-440e-9fce-5599d7e20536'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:19.862832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] The token cache is being invalidate because project 72329375f58e4879b0ae0e3e2458583d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:19.863711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:19.865437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:19.869347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 942/1883] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:19 2022] DELETE /identity/v3/projects/72329375f58e4879b0ae0e3e2458583d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:19.874707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:19.895601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461e95-741b-4bda-8b4b-0a58fc3329a4 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:20.002272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:20.002984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:20.003259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:20.003530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] PATH_INFO: `/v3/users/a7579a4d8d6943ee98d09ba24e596070` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:20.004755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7579a4d8d6943ee98d09ba24e596070)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:20.007914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:20.069435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:20.089743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7579a4d8d6943ee98d09ba24e596070'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:20.130521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7579a4d8d6943ee98d09ba24e596070'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:20.170339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7579a4d8d6943ee98d09ba24e596070'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:20.173532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7579a4d8d6943ee98d09ba24e596070'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:20.175725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7579a4d8d6943ee98d09ba24e596070'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:20.211648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 942/1884] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:19 2022] DELETE /identity/v3/users/a7579a4d8d6943ee98d09ba24e596070 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:21.076839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:21.080049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:21.122353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb588f-182d-440e-9fce-5599d7e20536 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:21.368898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:21.369628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.369966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.370299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] PATH_INFO: `/v3/projects/3f861494b4ef40228490d1f897b99158` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.371540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f861494b4ef40228490d1f897b99158)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:21.374021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:21.375742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:21.378418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:21.440521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f861494b4ef40228490d1f897b99158', 'request_id': 'req-063af4d8-edf3-46cc-948a-e196859ff9c2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:21.446747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f861494b4ef40228490d1f897b99158', 'request_id': 'req-063af4d8-edf3-46cc-948a-e196859ff9c2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:21.477283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf67a52-5ab3-4a99-ae3a-8ec80d52b656 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:21.479001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f861494b4ef40228490d1f897b99158', 'request_id': 'req-063af4d8-edf3-46cc-948a-e196859ff9c2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:21.495104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] The token cache is being invalidate because project 3f861494b4ef40228490d1f897b99158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:21.495386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:21.496511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-063af4d8-edf3-46cc-948a-e196859ff9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:21.498993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 943/1885] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:21 2022] DELETE /identity/v3/projects/3f861494b4ef40228490d1f897b99158 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:21.505186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191cafc-9da3-45ce-95ce-dbddf0cfdc2f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.505592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191cafc-9da3-45ce-95ce-dbddf0cfdc2f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.505909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191cafc-9da3-45ce-95ce-dbddf0cfdc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.549016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:21.550037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.550518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.550844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4191cafc-9da3-45ce-95ce-dbddf0cfdc2f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:21.551166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.552345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4191cafc-9da3-45ce-95ce-dbddf0cfdc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:21.553368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:21.668912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:21.670659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:21.691086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 944/1886] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:21.702151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5adfa-df97-40ba-8923-cd8247807b1f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.702408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5adfa-df97-40ba-8923-cd8247807b1f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.702686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5adfa-df97-40ba-8923-cd8247807b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.708691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 943/1887] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:21.762967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7ed5adfa-df97-40ba-8923-cd8247807b1f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:21.764590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7ed5adfa-df97-40ba-8923-cd8247807b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:21.773784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 945/1888] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:21.778423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:21.795195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ce7f-d24a-4deb-8f0e-d60fbf104977 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:21.804436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:21.805270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.805450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.805729 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.806397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:21.806708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:21.813644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:21.843463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:21.853703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 944/1889] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:21.860188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5adfa-df97-40ba-8923-cd8247807b1f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:21.874433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5adfa-df97-40ba-8923-cd8247807b1f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:21.884055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:21.884991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:21.885267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:21.885541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:21.886193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:21.892505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:21.924486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:21.977645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 946/1890] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:21 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:21.978422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:21.992221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79040f4-1fe6-4c67-b202-30179b0b9c56 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.108653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.109836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.110276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.110646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.111414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.114258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.148101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 945/1891] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:21 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:22.153514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.169403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb468a6-6340-43c7-ae92-e852be6948af admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.217140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.217938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.218299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.218806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.219552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.222192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.245828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 947/1892] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:22.249023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.264832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b6f95-fb20-4d34-856d-3eaf6a26737f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.295260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97108a-2b5e-440c-a816-289f08cfd2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.296421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97108a-2b5e-440c-a816-289f08cfd2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.296895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97108a-2b5e-440c-a816-289f08cfd2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.297254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97108a-2b5e-440c-a816-289f08cfd2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.298088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97108a-2b5e-440c-a816-289f08cfd2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.299873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97108a-2b5e-440c-a816-289f08cfd2ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.341723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 946/1893] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:22.346108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.366549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a784e2-c933-4255-8aa6-48aabe895a59 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.380198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.381407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.381407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.381641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] PATH_INFO: `/v3/projects/aae5b46f245c431ea0b992418d57c6db/users/fd3415de15af449a9975b200d7182543/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.423440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae5b46f245c431ea0b992418d57c6db, user_id=fd3415de15af449a9975b200d7182543, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.426995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.455313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 948/1894] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:22 2022] PUT /identity/v3/projects/aae5b46f245c431ea0b992418d57c6db/users/fd3415de15af449a9975b200d7182543/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:22.465704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.466264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.466264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.517876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] MFA Rules not processed for user `fd3415de15af449a9975b200d7182543`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:22.519566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:22.629935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 947/1895] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:22.637779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:22.641436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:22.797869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2371f-a339-4b0e-b4cf-cf3c203ef570 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:22.805142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82de79c-28a1-4100-bf1c-ed68d20d8e42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:22.806044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82de79c-28a1-4100-bf1c-ed68d20d8e42 service glance] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:22.806640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82de79c-28a1-4100-bf1c-ed68d20d8e42 service glance] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:22.808225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82de79c-28a1-4100-bf1c-ed68d20d8e42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:22.855620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82de79c-28a1-4100-bf1c-ed68d20d8e42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:22.861270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82de79c-28a1-4100-bf1c-ed68d20d8e42 service glance] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:22.894339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 949/1896] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:27.246967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:27.250993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:27.368580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235752a-8ccf-4613-a9a7-0c0c55f82ab5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:27.374537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:27.375196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:27.375469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:27.375733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] PATH_INFO: `/v3/users/14c24a4753f74beda18d0bab7abb62ac` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:27.376915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c24a4753f74beda18d0bab7abb62ac)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:27.378821 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:27.391681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:27.439568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c24a4753f74beda18d0bab7abb62ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:27.453268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c24a4753f74beda18d0bab7abb62ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:27.460591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c24a4753f74beda18d0bab7abb62ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:27.461377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c24a4753f74beda18d0bab7abb62ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:27.462007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c24a4753f74beda18d0bab7abb62ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:27.480491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 948/1897] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:27 2022] DELETE /identity/v3/users/14c24a4753f74beda18d0bab7abb62ac => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:27.487899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:27.488466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:27.488935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:27.525927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:27.528697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:27.604700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 950/1898] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:27.615899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:27.617401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:27.695531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51853-893b-4a2c-a760-30a8ca6e0171 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:27.700167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:27.700879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:27.701154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:27.701420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:27.712695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:27.714199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:27.724156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 949/1899] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:28.011568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:28.013121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:28.025701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0774e-800a-4a7e-9ad3-8c84ee91c01a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:28.031507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:28.032158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:28.032432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:28.032700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] PATH_INFO: `/v3/projects/8103a7bc6d8c4f9f822e8348a432e307` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:28.033989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8103a7bc6d8c4f9f822e8348a432e307)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:28.035956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:28.090811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8103a7bc6d8c4f9f822e8348a432e307', 'request_id': 'req-7f50e315-5526-4d0f-bb4b-3fb481e62d18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.092712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:28.097037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8103a7bc6d8c4f9f822e8348a432e307', 'request_id': 'req-7f50e315-5526-4d0f-bb4b-3fb481e62d18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.107679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8103a7bc6d8c4f9f822e8348a432e307', 'request_id': 'req-7f50e315-5526-4d0f-bb4b-3fb481e62d18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.121120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] The token cache is being invalidate because project 8103a7bc6d8c4f9f822e8348a432e307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:28.121485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.122442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.124030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 951/1900] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:28 2022] DELETE /identity/v3/projects/8103a7bc6d8c4f9f822e8348a432e307 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:28.128312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:28.140995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65085f8-eb09-4c40-a1b5-bed3de18b980 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:28.202766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:28.203457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:28.203727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:28.203994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] PATH_INFO: `/v3/users/5b30cb73a7bf4e2e96fb0165413dc51b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:28.205144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b30cb73a7bf4e2e96fb0165413dc51b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:28.207779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:28.249328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:28.264307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b30cb73a7bf4e2e96fb0165413dc51b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.278195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b30cb73a7bf4e2e96fb0165413dc51b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.285915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b30cb73a7bf4e2e96fb0165413dc51b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.286767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b30cb73a7bf4e2e96fb0165413dc51b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.287304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b30cb73a7bf4e2e96fb0165413dc51b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.302254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 950/1901] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:28 2022] DELETE /identity/v3/users/5b30cb73a7bf4e2e96fb0165413dc51b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:28.690046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:28.691981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:28.706791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:28.707641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50e315-5526-4d0f-bb4b-3fb481e62d18 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:28.708370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:28.802003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:28.802919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:28.803265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:28.803610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] PATH_INFO: `/v3/users/aa49bceec83941d69a89a60f80223c96` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:28.804853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa49bceec83941d69a89a60f80223c96)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:28.806887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:28.813537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1fe26-660d-4b64-b2db-2011b2ebf89c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:28.819512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:28.821339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:28.821620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:28.828387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] PATH_INFO: `/v3/projects/6ba5a787991c48a6aa6ab6334792ce86` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:28.830626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba5a787991c48a6aa6ab6334792ce86)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:28.833792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:28.867999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa49bceec83941d69a89a60f80223c96'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.876188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa49bceec83941d69a89a60f80223c96'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.885877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa49bceec83941d69a89a60f80223c96'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.886741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa49bceec83941d69a89a60f80223c96'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.895154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba5a787991c48a6aa6ab6334792ce86', 'request_id': 'req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.903048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba5a787991c48a6aa6ab6334792ce86', 'request_id': 'req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.907274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d73a7c22-28c6-46fb-a752-c0bccb63266c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa49bceec83941d69a89a60f80223c96'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.917888 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba5a787991c48a6aa6ab6334792ce86', 'request_id': 'req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.920037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 952/1902] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:28 2022] DELETE /identity/v3/users/aa49bceec83941d69a89a60f80223c96 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:28.924475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:28.924785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:28.925083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:28.944557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] The token cache is being invalidate because project 6ba5a787991c48a6aa6ab6334792ce86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:28.944938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.945508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b00f31-1a58-4a46-88a9-34ce9da2d4ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:28.947333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 951/1903] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:28 2022] DELETE /identity/v3/projects/6ba5a787991c48a6aa6ab6334792ce86 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:28.947554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:28.949317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:28.954714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb33f-a7f1-416d-ac9d-1ba727fe5cd8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:28.955004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb33f-a7f1-416d-ac9d-1ba727fe5cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:28.955558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb33f-a7f1-416d-ac9d-1ba727fe5cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:28.977035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c4bfb33f-a7f1-416d-ac9d-1ba727fe5cd8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:28.978307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4bfb33f-a7f1-416d-ac9d-1ba727fe5cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.020023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:29.036624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 953/1904] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:29.037338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:29.054199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.056194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.069045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 952/1905] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:29.078223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d121-c44f-4037-a2a1-e370ca1d65f9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.078611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d121-c44f-4037-a2a1-e370ca1d65f9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.078908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d121-c44f-4037-a2a1-e370ca1d65f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.100093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a8e7d121-c44f-4037-a2a1-e370ca1d65f9 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:29.101381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a8e7d121-c44f-4037-a2a1-e370ca1d65f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.110026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 953/1906] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:29.115151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7d121-c44f-4037-a2a1-e370ca1d65f9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.125676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7d121-c44f-4037-a2a1-e370ca1d65f9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.126050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf13392-bc16-480a-a59d-64626bb00f62 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.129987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.130644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.130778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.130922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.131199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.131338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.131617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.131887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.132603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:29.132942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.134761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.140986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.142424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.147209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 954/1907] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:29.151977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.157373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 954/1908] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:29.162597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f4172-affb-4cae-b8b8-9a018ee1c117 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.167524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.168247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.168534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.168994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.169650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.171593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.201928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 955/1909] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:29 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:29.206505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.216838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65be8dd-b86c-4fc9-a2c0-472c6c5a1ec3 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.285288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.286018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.286363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.286642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.287283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.289295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.312855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 955/1910] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:29 2022] POST /identity/v3/users => generated 281 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:29.317289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.343469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991f542-0798-4765-aa09-5caebf849c85 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.348469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.349130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.349408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.349682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.350340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.351963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.368420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 956/1911] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:29.369944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.382165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eedaba-f2b2-4969-b4eb-d26fcd40dc16 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.387191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cc5e8-e116-4b78-9f4c-4a064edd83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.387832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc5e8-e116-4b78-9f4c-4a064edd83a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.388101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc5e8-e116-4b78-9f4c-4a064edd83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.388373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc5e8-e116-4b78-9f4c-4a064edd83a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.389168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cc5e8-e116-4b78-9f4c-4a064edd83a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.390759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cc5e8-e116-4b78-9f4c-4a064edd83a7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.401636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 956/1912] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:29.406659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.419066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c81e9-4293-4040-9d46-247259786044 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.424869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.425915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.426376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.426787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] PATH_INFO: `/v3/projects/6c045561b83e4ff483398aa1a43a7733/users/5c57afd4a2ad4bb38623def565b82df3/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.448059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c045561b83e4ff483398aa1a43a7733, user_id=5c57afd4a2ad4bb38623def565b82df3, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.453103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.479469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 957/1913] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:29 2022] PUT /identity/v3/projects/6c045561b83e4ff483398aa1a43a7733/users/5c57afd4a2ad4bb38623def565b82df3/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:29.504129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.504553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.504961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.542340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] MFA Rules not processed for user `5c57afd4a2ad4bb38623def565b82df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:29.544566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.603376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.605731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.650679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 957/1914] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:29.693396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.695628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.711533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:29.727016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96422b47-1e3e-4222-b228-38a865dad0f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.732939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.733562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.734154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.734445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] PATH_INFO: `/v3/projects/6e743ec22587462a9328b5f044455c3f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.735559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e743ec22587462a9328b5f044455c3f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.737514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.771383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0147-dbd4-4f98-8f44-9601d89fde51 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.778842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.779570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.779910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.780186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.790604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.792742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.803882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 958/1915] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:03:29.806242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e743ec22587462a9328b5f044455c3f', 'request_id': 'req-c01860b3-6e2e-407f-b35e-923549857260'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:29.814556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e743ec22587462a9328b5f044455c3f', 'request_id': 'req-c01860b3-6e2e-407f-b35e-923549857260'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:29.820686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.845561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e743ec22587462a9328b5f044455c3f', 'request_id': 'req-c01860b3-6e2e-407f-b35e-923549857260'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:29.845705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e61a36-f827-4eec-b2d7-9064e6c3f028 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.845798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:29.851661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] The token cache is being invalidate because project 6e743ec22587462a9328b5f044455c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:29.851841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:29.853398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:29.855285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 958/1916] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:29 2022] DELETE /identity/v3/projects/6e743ec22587462a9328b5f044455c3f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:29.859987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:29.862052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:29.926554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.929385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.929741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.930117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] PATH_INFO: `/v3/users/5c57afd4a2ad4bb38623def565b82df3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.931384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c57afd4a2ad4bb38623def565b82df3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.933416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.961503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01860b3-6e2e-407f-b35e-923549857260 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:29.966731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:29.967442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:29.967691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:29.968454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] PATH_INFO: `/v3/users/cd637e3805cc485496bcf3989a43a23a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:29.969344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd637e3805cc485496bcf3989a43a23a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:29.971391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:29.992958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c57afd4a2ad4bb38623def565b82df3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.001822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c57afd4a2ad4bb38623def565b82df3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.012638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c57afd4a2ad4bb38623def565b82df3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.013562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c57afd4a2ad4bb38623def565b82df3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.035528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd637e3805cc485496bcf3989a43a23a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.039855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-49ca0e3d-558c-4d68-8966-90b1d502133b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c57afd4a2ad4bb38623def565b82df3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.048035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 959/1917] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:29 2022] DELETE /identity/v3/users/5c57afd4a2ad4bb38623def565b82df3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:30.052610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595805-6541-4334-8034-938b7d5c2ced None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.052931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595805-6541-4334-8034-938b7d5c2ced None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.053213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595805-6541-4334-8034-938b7d5c2ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.055377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd637e3805cc485496bcf3989a43a23a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.066516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd637e3805cc485496bcf3989a43a23a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.067689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd637e3805cc485496bcf3989a43a23a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.068515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd637e3805cc485496bcf3989a43a23a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.074675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-95595805-6541-4334-8034-938b7d5c2ced None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:30.076093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-95595805-6541-4334-8034-938b7d5c2ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:30.093583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 959/1918] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:29 2022] DELETE /identity/v3/users/cd637e3805cc485496bcf3989a43a23a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:30.129532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:30.167586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 960/1919] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:30.181905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:30.183927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:30.265254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615b27c-5c4a-4750-935e-b27308c107cf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:30.268869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c253a35-79c8-4a1c-9579-2d1e63f2486d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:30.269484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253a35-79c8-4a1c-9579-2d1e63f2486d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.269759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253a35-79c8-4a1c-9579-2d1e63f2486d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.270051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253a35-79c8-4a1c-9579-2d1e63f2486d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.299345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:30.350201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c253a35-79c8-4a1c-9579-2d1e63f2486d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:30.351574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c253a35-79c8-4a1c-9579-2d1e63f2486d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:30.368859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 960/1920] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:30.485133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95595805-6541-4334-8034-938b7d5c2ced None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:30.486749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-95595805-6541-4334-8034-938b7d5c2ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:30.500278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95595805-6541-4334-8034-938b7d5c2ced None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:30.505962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:30.506618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.506971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.507143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] PATH_INFO: `/v3/projects/18696c5963a84045a895c0e6863b28c0` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.518608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=18696c5963a84045a895c0e6863b28c0)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:30.521541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:30.580622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18696c5963a84045a895c0e6863b28c0', 'request_id': 'req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.586647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18696c5963a84045a895c0e6863b28c0', 'request_id': 'req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.596961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18696c5963a84045a895c0e6863b28c0', 'request_id': 'req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.609778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] The token cache is being invalidate because project 18696c5963a84045a895c0e6863b28c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:30.610065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.610718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ff3b6d8c-73a1-4d99-ae0a-e96563ca0faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.612282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 961/1921] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:30 2022] DELETE /identity/v3/projects/18696c5963a84045a895c0e6863b28c0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:30.617778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.618075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.618652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.646034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:30.647255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:30.716265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 961/1922] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:30.724283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6df2-90a4-47ea-a7c1-807d8f4a871c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.724857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6df2-90a4-47ea-a7c1-807d8f4a871c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.725025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6df2-90a4-47ea-a7c1-807d8f4a871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.737507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:30.739539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:30.750981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-486b6df2-90a4-47ea-a7c1-807d8f4a871c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:30.752417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-486b6df2-90a4-47ea-a7c1-807d8f4a871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:30.760734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ce851-c51d-44e6-b298-32e0e76524e2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:30.764923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 962/1923] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:30.766221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6df2-90a4-47ea-a7c1-807d8f4a871c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:30.769850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:30.770628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.770941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.771214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] PATH_INFO: `/v3/projects/6c045561b83e4ff483398aa1a43a7733` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.772487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c045561b83e4ff483398aa1a43a7733)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:30.778065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6df2-90a4-47ea-a7c1-807d8f4a871c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:30.779185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:30.789388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:30.790118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.790728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.791035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.791993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:30.792377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:30.795633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:30.812795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 963/1924] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:30.813962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:30.824638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943609e8-87df-4b56-9898-d0ccb08bc9ed admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:30.830811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:30.831592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.831898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.832139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.832842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:30.835444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:30.843981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c045561b83e4ff483398aa1a43a7733', 'request_id': 'req-c549b655-81ce-444c-bfae-c4819c7c77d6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.868743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c045561b83e4ff483398aa1a43a7733', 'request_id': 'req-c549b655-81ce-444c-bfae-c4819c7c77d6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.875728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c045561b83e4ff483398aa1a43a7733', 'request_id': 'req-c549b655-81ce-444c-bfae-c4819c7c77d6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.881597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 964/1925] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:30 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:30.886010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:30.893034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] The token cache is being invalidate because project 6c045561b83e4ff483398aa1a43a7733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:30.893408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.894135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c549b655-81ce-444c-bfae-c4819c7c77d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:30.896051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 962/1926] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:30 2022] DELETE /identity/v3/projects/6c045561b83e4ff483398aa1a43a7733 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:30.901082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.901527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.901923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.927482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:30.928946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:30.967975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd2f0e-8002-4625-a3f8-b4f41a593b65 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:30.972731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12028f8f-ff62-4d28-91a0-323c425712ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:30.973369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12028f8f-ff62-4d28-91a0-323c425712ef admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:30.973650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12028f8f-ff62-4d28-91a0-323c425712ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:30.973959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12028f8f-ff62-4d28-91a0-323c425712ef admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:30.974597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12028f8f-ff62-4d28-91a0-323c425712ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:30.976625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12028f8f-ff62-4d28-91a0-323c425712ef admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:30.983708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:31.005711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 963/1927] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:31.007378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 965/1928] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:30 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:31.011429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.013472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:31.014404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057b2f3-d2df-4a6b-be47-b5963eac4662 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.014867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057b2f3-d2df-4a6b-be47-b5963eac4662 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.015297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057b2f3-d2df-4a6b-be47-b5963eac4662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.027380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9cc7-79ef-46c9-aae2-636b79066de0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.037672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.038301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.038575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.038837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.039482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.041168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.043088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:31.062286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 964/1929] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:31.064004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.069666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a057b2f3-d2df-4a6b-be47-b5963eac4662 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:31.071105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a057b2f3-d2df-4a6b-be47-b5963eac4662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:31.075764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d369dd-3b25-4ba9-a71c-0a61750af08c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.080872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.081596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.082019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.082501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.083216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.084933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 966/1930] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:31.085258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.090261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057b2f3-d2df-4a6b-be47-b5963eac4662 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.101195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 965/1931] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:31.101879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057b2f3-d2df-4a6b-be47-b5963eac4662 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.102259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.112588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.113487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.113981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.114415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.115229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:31.115700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.117436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.120459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733fec2-fbf4-4bfb-ab3c-12f1526e666e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.133931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74128d1c-6440-4ffc-ad67-71284b402578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.134780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74128d1c-6440-4ffc-ad67-71284b402578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.135201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74128d1c-6440-4ffc-ad67-71284b402578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.135780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74128d1c-6440-4ffc-ad67-71284b402578 admin admin] PATH_INFO: `/v3/projects/3befda9730c04e54beab7be4518917e6/users/9cbe85a5304a4e0989f57995753f4cdd/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.144050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 967/1932] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:31.149299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.158237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74128d1c-6440-4ffc-ad67-71284b402578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3befda9730c04e54beab7be4518917e6, user_id=9cbe85a5304a4e0989f57995753f4cdd, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.161355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74128d1c-6440-4ffc-ad67-71284b402578 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.163418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b419f62-c6be-461b-b7c1-e65114ec9a66 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.169739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.170437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.170833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.172549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.173255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.175325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.188551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 966/1933] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:31 2022] PUT /identity/v3/projects/3befda9730c04e54beab7be4518917e6/users/9cbe85a5304a4e0989f57995753f4cdd/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:31.202640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228eff-f2a2-48e8-a796-9c5085eb3a7e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.203003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228eff-f2a2-48e8-a796-9c5085eb3a7e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.203680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69228eff-f2a2-48e8-a796-9c5085eb3a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.221367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 968/1934] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:31.225910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.245180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-69228eff-f2a2-48e8-a796-9c5085eb3a7e None None] MFA Rules not processed for user `9cbe85a5304a4e0989f57995753f4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:31.246516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-69228eff-f2a2-48e8-a796-9c5085eb3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:31.348696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 967/1935] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:31.350751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cca18-a486-48e5-bf12-e517ee09a9a6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.353416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69228eff-f2a2-48e8-a796-9c5085eb3a7e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.359920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.360646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.361013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.361393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.362880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.365374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.367296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69228eff-f2a2-48e8-a796-9c5085eb3a7e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.372429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.373210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.373464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.373728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.374373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.376530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.398734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 969/1936] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:31.400124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.412169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6b98-2abf-45ef-b0ff-79d20511c11d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.412303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 968/1937] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:31.416298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.484076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99072969-087f-428f-b477-769daddbb987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.484822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99072969-087f-428f-b477-769daddbb987 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.485186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99072969-087f-428f-b477-769daddbb987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.485533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99072969-087f-428f-b477-769daddbb987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.486285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99072969-087f-428f-b477-769daddbb987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.487896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99072969-087f-428f-b477-769daddbb987 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.500349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 970/1938] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:31.504330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99072969-087f-428f-b477-769daddbb987 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.507729 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579060-f320-414b-aebe-e1b01216cbe2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.512997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.513929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.514306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.514675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.514770 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99072969-087f-428f-b477-769daddbb987 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.515548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.517721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.519837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.520453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.520726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.521053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.521704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.523272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.536153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 971/1939] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:31.543340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:31.545884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.556364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 969/1940] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:31.557428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.560407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a297bb-955d-4d61-8984-4c40f2266e2c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.565234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52231f6f-3df3-4c49-9d61-0d09329bb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.565902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231f6f-3df3-4c49-9d61-0d09329bb51c admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.566184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231f6f-3df3-4c49-9d61-0d09329bb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.566452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231f6f-3df3-4c49-9d61-0d09329bb51c admin admin] PATH_INFO: `/v3/projects/c10979066b4a4ec8bd5be7f6084cbbdf/users/59d57d78b9c14b859009f8ff71a00c5c/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.567239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730cd81-d36e-4cc2-a7ad-2a25124c93ec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.571737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.572302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.572574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.573529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.574379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.575984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.582383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52231f6f-3df3-4c49-9d61-0d09329bb51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10979066b4a4ec8bd5be7f6084cbbdf, user_id=59d57d78b9c14b859009f8ff71a00c5c, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.585589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52231f6f-3df3-4c49-9d61-0d09329bb51c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.590348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 970/1941] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:31.591734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.602077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 972/1942] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:31 2022] PUT /identity/v3/projects/c10979066b4a4ec8bd5be7f6084cbbdf/users/59d57d78b9c14b859009f8ff71a00c5c/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:31.602873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da32f1-0105-4b41-8168-ea4e38776bb4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.607568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.607850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.608122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.633637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:31.635267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:31.645337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:31.670341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.671015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.671292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.671565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] PATH_INFO: `/v3/projects/e2b35f1d2809418caffe3d4c7485f7b5/users/d4930cd30a0b4d4282445248a9b037ec/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.687132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b35f1d2809418caffe3d4c7485f7b5, user_id=d4930cd30a0b4d4282445248a9b037ec, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.690028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.700535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 973/1943] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:31.707377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 971/1944] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:31 2022] PUT /identity/v3/projects/e2b35f1d2809418caffe3d4c7485f7b5/users/d4930cd30a0b4d4282445248a9b037ec/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:31.710369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.711448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.711778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:31.779424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e07dba-2f98-4dbb-a9f0-5729b4bf14e5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.779603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2a910-bff2-4a65-9ea3-17d2dbb01a7a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.783997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.784602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.784913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.785223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.785819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.787425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.799209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 972/1945] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:31.803126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.813237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764b1de-08ca-49fb-bc04-0a4b28f9110d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:31.818914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a77908-34f1-437f-a567-d1972f2db01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.819569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77908-34f1-437f-a567-d1972f2db01a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.819842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77908-34f1-437f-a567-d1972f2db01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.820109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77908-34f1-437f-a567-d1972f2db01a admin admin] PATH_INFO: `/v3/projects/e2b35f1d2809418caffe3d4c7485f7b5/users/d4930cd30a0b4d4282445248a9b037ec/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.822315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a77908-34f1-437f-a567-d1972f2db01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b35f1d2809418caffe3d4c7485f7b5, user_id=d4930cd30a0b4d4282445248a9b037ec, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.825125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a77908-34f1-437f-a567-d1972f2db01a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.835876 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:31.836599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 973/1946] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:31 2022] PUT /identity/v3/projects/e2b35f1d2809418caffe3d4c7485f7b5/users/d4930cd30a0b4d4282445248a9b037ec/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:31.836733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.837502 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.837502 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.847963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25cc53-a100-4b31-9f13-c1b1e53dbccf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:31.847963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25cc53-a100-4b31-9f13-c1b1e53dbccf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:31.848258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25cc53-a100-4b31-9f13-c1b1e53dbccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:31.851456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:31.853135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:31.870382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 974/1947] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:31.883132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7d25cc53-a100-4b31-9f13-c1b1e53dbccf None None] MFA Rules not processed for user `d4930cd30a0b4d4282445248a9b037ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:31.884436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d25cc53-a100-4b31-9f13-c1b1e53dbccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:31.934666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:31.978089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 974/1948] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:31.992889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:31.995589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:32.087272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43debc-30a8-430a-84a1-fc25cc545125 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:32.151901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:32.182275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8bca-ac3b-442a-ba8a-b8d110a06258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:32.183174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8bca-ac3b-442a-ba8a-b8d110a06258 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:32.183454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8bca-ac3b-442a-ba8a-b8d110a06258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:32.183796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8bca-ac3b-442a-ba8a-b8d110a06258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:32.194976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8bca-ac3b-442a-ba8a-b8d110a06258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:32.196460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8bca-ac3b-442a-ba8a-b8d110a06258 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:32.211730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 975/1949] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:32.396011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25cc53-a100-4b31-9f13-c1b1e53dbccf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:32.494167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25cc53-a100-4b31-9f13-c1b1e53dbccf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:32.500373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:32.501486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:32.501486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:32.501701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] PATH_INFO: `/v3/users/9cbe85a5304a4e0989f57995753f4cdd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:32.509920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbe85a5304a4e0989f57995753f4cdd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:32.525411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:32.594381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbe85a5304a4e0989f57995753f4cdd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:32.610591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbe85a5304a4e0989f57995753f4cdd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:32.618740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbe85a5304a4e0989f57995753f4cdd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:32.620889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbe85a5304a4e0989f57995753f4cdd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:32.620889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbe85a5304a4e0989f57995753f4cdd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:32.644211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 975/1950] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:32 2022] DELETE /identity/v3/users/9cbe85a5304a4e0989f57995753f4cdd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:32.645725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a2cd3-22af-41f7-8ae9-f801d70ade18 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:32.646106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a2cd3-22af-41f7-8ae9-f801d70ade18 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:32.646476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a2cd3-22af-41f7-8ae9-f801d70ade18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:32.668205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-015a2cd3-22af-41f7-8ae9-f801d70ade18 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:32.669558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-015a2cd3-22af-41f7-8ae9-f801d70ade18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:32.743912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 976/1951] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:32.765006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:32.766641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:32.828361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857561d-5ad3-4d3b-8300-c0e0f92291cf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:32.841815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:32.842466 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:32.842743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:32.843016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:32.863400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:32.863913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:32.864497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:32.864913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:32.865016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:32.871866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:32.879123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 976/1952] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:32.907299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] MFA Rules not processed for user `59d57d78b9c14b859009f8ff71a00c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:32.909009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:32.994027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 977/1953] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:33.015560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:33.017836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:33.103684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57464f95-5ecf-4d31-9888-bc3dd87fbbc3 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:33.112493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:33.113663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:33.114931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:33.115408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:33.147931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:33.150073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:33.164382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 977/1954] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:33.492769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:33.495456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:33.519484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee71e4-42e9-44b7-b87c-aad816de1d2d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:33.526434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:33.529633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:33.529948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:33.530232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] PATH_INFO: `/v3/projects/3befda9730c04e54beab7be4518917e6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:33.531677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3befda9730c04e54beab7be4518917e6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:33.534740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:33.664275 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3befda9730c04e54beab7be4518917e6', 'request_id': 'req-d4d552ed-62f1-4262-b8e1-dd39645b7239'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.682267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:33.683982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3befda9730c04e54beab7be4518917e6', 'request_id': 'req-d4d552ed-62f1-4262-b8e1-dd39645b7239'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.697276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3befda9730c04e54beab7be4518917e6', 'request_id': 'req-d4d552ed-62f1-4262-b8e1-dd39645b7239'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.715197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] The token cache is being invalidate because project 3befda9730c04e54beab7be4518917e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:33.715497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.719395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.719395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 978/1955] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:33 2022] DELETE /identity/v3/projects/3befda9730c04e54beab7be4518917e6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:33.724613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:33.739164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea98b3-5636-4244-b79b-bb912ee290f1 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:33.815393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:33.816068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:33.816290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:33.816586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] PATH_INFO: `/v3/users/d4930cd30a0b4d4282445248a9b037ec` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:33.817775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4930cd30a0b4d4282445248a9b037ec)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:33.819722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:33.872591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4930cd30a0b4d4282445248a9b037ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.889388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4930cd30a0b4d4282445248a9b037ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.900563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4930cd30a0b4d4282445248a9b037ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.901389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4930cd30a0b4d4282445248a9b037ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.902017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3e1ce84d-6e3e-4844-88ee-f0a0bfea6b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4930cd30a0b4d4282445248a9b037ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:33.918279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 978/1956] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:33 2022] DELETE /identity/v3/users/d4930cd30a0b4d4282445248a9b037ec => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:34.213592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.215561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:34.229540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d552ed-62f1-4262-b8e1-dd39645b7239 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:34.289235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:34.289897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.290180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.290453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] PATH_INFO: `/v3/projects/e2b35f1d2809418caffe3d4c7485f7b5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.291648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b35f1d2809418caffe3d4c7485f7b5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:34.294343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:34.356657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b35f1d2809418caffe3d4c7485f7b5', 'request_id': 'req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:34.362567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b35f1d2809418caffe3d4c7485f7b5', 'request_id': 'req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:34.372138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b35f1d2809418caffe3d4c7485f7b5', 'request_id': 'req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:34.384147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] The token cache is being invalidate because project e2b35f1d2809418caffe3d4c7485f7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:34.384434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:34.385126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1b6e496-abe0-4c5b-af3c-4f1eeb890006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:34.386701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 979/1957] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:34 2022] DELETE /identity/v3/projects/e2b35f1d2809418caffe3d4c7485f7b5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:34.392188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851a220-87d2-484d-83d5-1aecacfc440b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.392475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851a220-87d2-484d-83d5-1aecacfc440b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.392764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851a220-87d2-484d-83d5-1aecacfc440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.414800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b851a220-87d2-484d-83d5-1aecacfc440b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:34.416041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b851a220-87d2-484d-83d5-1aecacfc440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:34.436436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:34.494327 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 979/1958] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:34.502742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ce7d-aaf4-4423-aa67-6e464ca828e8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.503023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ce7d-aaf4-4423-aa67-6e464ca828e8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.503295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ce7d-aaf4-4423-aa67-6e464ca828e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.523255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-29b7ce7d-aaf4-4423-aa67-6e464ca828e8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:34.524493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-29b7ce7d-aaf4-4423-aa67-6e464ca828e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:34.532617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 980/1959] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:34.537065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851a220-87d2-484d-83d5-1aecacfc440b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.547629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851a220-87d2-484d-83d5-1aecacfc440b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:34.552322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:34.553015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.553252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.553520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.554167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:34.554464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:34.556117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:34.569642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 980/1960] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:34.574050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7ce7d-aaf4-4423-aa67-6e464ca828e8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.583709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7ce7d-aaf4-4423-aa67-6e464ca828e8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:34.588995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:34.589530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.589816 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.590087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.590743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:34.592793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:34.622850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 981/1961] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:34 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:34.627081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.641936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a134303-a91f-4d55-84bd-953824b10d94 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:34.702868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:34.703491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.703767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.704035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.704717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:34.706735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:34.737091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 981/1962] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:34 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:34.738594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.752108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d94fe-baec-4c61-aaa0-19c64b3ca523 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:34.757419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff01615-645c-4821-8328-1d54b2ddc393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:34.758140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01615-645c-4821-8328-1d54b2ddc393 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.758492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01615-645c-4821-8328-1d54b2ddc393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.758833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01615-645c-4821-8328-1d54b2ddc393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.759837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff01615-645c-4821-8328-1d54b2ddc393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:34.761712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff01615-645c-4821-8328-1d54b2ddc393 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:34.777347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 982/1963] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:34.782011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.793172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157eff-31e8-4985-8fed-c4677d996223 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:34.795210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6d69-3f9a-4854-968b-6a82917216bb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.795665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6d69-3f9a-4854-968b-6a82917216bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.796112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6d69-3f9a-4854-968b-6a82917216bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.798971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:34.799598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.800249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.800358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.801202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:34.802864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:34.816158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 982/1964] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:34.817880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-573a6d69-3f9a-4854-968b-6a82917216bb None None] MFA Rules not processed for user `59d57d78b9c14b859009f8ff71a00c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:34.819282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-573a6d69-3f9a-4854-968b-6a82917216bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:34.820699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.830753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308af7e-6120-4a02-ac46-9f0cdffd7be0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:34.835417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3232-7a38-4089-892d-ccdcd7d66a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:34.836059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3232-7a38-4089-892d-ccdcd7d66a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.836334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3232-7a38-4089-892d-ccdcd7d66a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.836602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3232-7a38-4089-892d-ccdcd7d66a44 admin admin] PATH_INFO: `/v3/projects/d12aba8f206a4d539fedd4776c917c65/users/3216cf716e1342faa71cc0252cb93de0/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.851225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:34.852379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c3232-7a38-4089-892d-ccdcd7d66a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12aba8f206a4d539fedd4776c917c65, user_id=3216cf716e1342faa71cc0252cb93de0, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:34.854926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c3232-7a38-4089-892d-ccdcd7d66a44 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:34.869255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 983/1965] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:34 2022] PUT /identity/v3/projects/d12aba8f206a4d539fedd4776c917c65/users/3216cf716e1342faa71cc0252cb93de0/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:34.879328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 983/1966] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:34.880306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7d14-e4b7-42c8-bf3e-460a9edb2182 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:34.880641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7d14-e4b7-42c8-bf3e-460a9edb2182 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:34.880946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c7d14-e4b7-42c8-bf3e-460a9edb2182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:34.913740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-457c7d14-e4b7-42c8-bf3e-460a9edb2182 None None] MFA Rules not processed for user `3216cf716e1342faa71cc0252cb93de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:34.913740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-457c7d14-e4b7-42c8-bf3e-460a9edb2182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:34.971795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:34.983511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 984/1967] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:34.988368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6d69-3f9a-4854-968b-6a82917216bb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:34.999224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6d69-3f9a-4854-968b-6a82917216bb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.061448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.062159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.062484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.062846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.063628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.065844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.099149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 984/1968] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:34 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:35.103367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c7d14-e4b7-42c8-bf3e-460a9edb2182 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.114736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c7d14-e4b7-42c8-bf3e-460a9edb2182 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.173247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.173868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.174155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.174714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.175405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.177419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.200711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 985/1969] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:35 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:35.204922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.215614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a790-43dd-4bff-ac6d-cb7f9168e5d6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.220968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.221682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.222054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.222326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.222972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.224570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.236575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 985/1970] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:35.241321 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.252770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e913308-93cf-4089-b166-29e9dff8e728 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.258103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.258804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.259094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.259373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] PATH_INFO: `/v3/projects/5eae6117bee04567b37170f74dfc6f74/users/28ec785271c34a53922b2a32c358a00a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.277737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eae6117bee04567b37170f74dfc6f74, user_id=28ec785271c34a53922b2a32c358a00a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.282102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.299006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 986/1971] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:35 2022] PUT /identity/v3/projects/5eae6117bee04567b37170f74dfc6f74/users/28ec785271c34a53922b2a32c358a00a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:35.303172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.316035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa0996-1dd2-4011-a7d9-c516c7d52b25 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.374895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2998fdc-5349-4ee9-9e1c-7095e5112211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.375596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2998fdc-5349-4ee9-9e1c-7095e5112211 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.375950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2998fdc-5349-4ee9-9e1c-7095e5112211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.376338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2998fdc-5349-4ee9-9e1c-7095e5112211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.377068 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2998fdc-5349-4ee9-9e1c-7095e5112211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.378682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2998fdc-5349-4ee9-9e1c-7095e5112211 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.390252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 986/1972] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:35.394803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.406653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c97d1a-3630-4ca3-8bda-030c722d99a3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.411578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.412293 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.412629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.412882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] PATH_INFO: `/v3/projects/5eae6117bee04567b37170f74dfc6f74/users/28ec785271c34a53922b2a32c358a00a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.414920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eae6117bee04567b37170f74dfc6f74, user_id=28ec785271c34a53922b2a32c358a00a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.417775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.430408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 987/1973] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:35 2022] PUT /identity/v3/projects/5eae6117bee04567b37170f74dfc6f74/users/28ec785271c34a53922b2a32c358a00a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:35.448224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83238b-41cf-4b81-9ba6-edc16de22b6b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.448513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83238b-41cf-4b81-9ba6-edc16de22b6b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.448792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83238b-41cf-4b81-9ba6-edc16de22b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.485763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4f83238b-41cf-4b81-9ba6-edc16de22b6b None None] MFA Rules not processed for user `28ec785271c34a53922b2a32c358a00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:35.488066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4f83238b-41cf-4b81-9ba6-edc16de22b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:35.571222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:35.614833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 987/1974] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:35.629630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.630914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:35.726629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091650-2b80-4e85-8df9-22e98c8f4f88 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.730749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.731510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.731828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.732143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.743209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.749094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.763364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 988/1975] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:35.864761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83238b-41cf-4b81-9ba6-edc16de22b6b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:35.877012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83238b-41cf-4b81-9ba6-edc16de22b6b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:35.894481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c23a7-dc32-4aca-939f-88eb11bfa372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:35.895249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c23a7-dc32-4aca-939f-88eb11bfa372 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:35.895627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c23a7-dc32-4aca-939f-88eb11bfa372 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:35.895999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c23a7-dc32-4aca-939f-88eb11bfa372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:35.974846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c23a7-dc32-4aca-939f-88eb11bfa372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:35.976311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c23a7-dc32-4aca-939f-88eb11bfa372 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:35.987143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 988/1976] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:41.506767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:41.558391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:41.574887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203ab8-c917-4c9c-993e-14e7c3298d32 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:41.580265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:41.580927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:41.581205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:41.581474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] PATH_INFO: `/v3/users/3216cf716e1342faa71cc0252cb93de0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:41.582607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3216cf716e1342faa71cc0252cb93de0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:41.584514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:41.634816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3216cf716e1342faa71cc0252cb93de0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:41.646724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3216cf716e1342faa71cc0252cb93de0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:41.653632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3216cf716e1342faa71cc0252cb93de0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:41.654416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3216cf716e1342faa71cc0252cb93de0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:41.655159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3216cf716e1342faa71cc0252cb93de0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:41.674249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 989/1977] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:41 2022] DELETE /identity/v3/users/3216cf716e1342faa71cc0252cb93de0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:41.679004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:41.679501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:41.679602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:41.700130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:41.701470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:41.772321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 989/1978] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:41.782269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:41.783723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:41.842002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d4dd-6767-47ed-bfc7-5f963ffdbd95 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:41.846335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:41.846940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:41.847213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:41.847463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:41.858917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:41.860658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:41.873594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 990/1979] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:42.536915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:42.552255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:42.565233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890e04-0a91-4a6a-a41b-78415ef2013d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:42.571197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:42.572344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:42.572782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:42.573242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] PATH_INFO: `/v3/projects/d12aba8f206a4d539fedd4776c917c65` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:42.574722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12aba8f206a4d539fedd4776c917c65)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:42.577314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:42.645175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12aba8f206a4d539fedd4776c917c65', 'request_id': 'req-d009a34f-dad7-43f7-a035-0d11aafb295d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.654346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12aba8f206a4d539fedd4776c917c65', 'request_id': 'req-d009a34f-dad7-43f7-a035-0d11aafb295d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.664771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12aba8f206a4d539fedd4776c917c65', 'request_id': 'req-d009a34f-dad7-43f7-a035-0d11aafb295d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.677474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:42.683227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] The token cache is being invalidate because project d12aba8f206a4d539fedd4776c917c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:42.683227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.684760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.686629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 990/1980] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:42 2022] DELETE /identity/v3/projects/d12aba8f206a4d539fedd4776c917c65 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:42.691531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:42.706640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35957-2221-4f34-a59d-9883ee14e80e service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:42.773322 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:42.774185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:42.774731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:42.775199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] PATH_INFO: `/v3/users/28ec785271c34a53922b2a32c358a00a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:42.777100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ec785271c34a53922b2a32c358a00a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:42.779332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:42.794309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:42.848613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ec785271c34a53922b2a32c358a00a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.865142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ec785271c34a53922b2a32c358a00a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.873848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ec785271c34a53922b2a32c358a00a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.874587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ec785271c34a53922b2a32c358a00a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.875183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17f0a22b-0719-4083-b83b-c43d52f175bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ec785271c34a53922b2a32c358a00a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:42.909551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 991/1981] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:42 2022] DELETE /identity/v3/users/28ec785271c34a53922b2a32c358a00a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:44.172562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:44.174168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:44.188246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009a34f-dad7-43f7-a035-0d11aafb295d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:44.267182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:44.268263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.268757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.269278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] PATH_INFO: `/v3/projects/5eae6117bee04567b37170f74dfc6f74` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:44.270962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eae6117bee04567b37170f74dfc6f74)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:44.273041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:44.330341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eae6117bee04567b37170f74dfc6f74', 'request_id': 'req-74fb9c87-f363-495f-84af-0f95cabfdac0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.339464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eae6117bee04567b37170f74dfc6f74', 'request_id': 'req-74fb9c87-f363-495f-84af-0f95cabfdac0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.354195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eae6117bee04567b37170f74dfc6f74', 'request_id': 'req-74fb9c87-f363-495f-84af-0f95cabfdac0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.373318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] The token cache is being invalidate because project 5eae6117bee04567b37170f74dfc6f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:44.373603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.376780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-74fb9c87-f363-495f-84af-0f95cabfdac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.380171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 991/1982] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:44 2022] DELETE /identity/v3/projects/5eae6117bee04567b37170f74dfc6f74 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:44.384901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9aef-ce6f-4547-b06c-4c295227baad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.385988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9aef-ce6f-4547-b06c-4c295227baad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.386452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9aef-ce6f-4547-b06c-4c295227baad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:44.407676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-394b9aef-ce6f-4547-b06c-4c295227baad None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:44.409003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-394b9aef-ce6f-4547-b06c-4c295227baad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:44.499862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 992/1983] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:44.501130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea9a5-1eb9-43d6-88ef-34780d8bab63 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.501371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea9a5-1eb9-43d6-88ef-34780d8bab63 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.501645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea9a5-1eb9-43d6-88ef-34780d8bab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:44.525885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f83ea9a5-1eb9-43d6-88ef-34780d8bab63 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:44.527129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f83ea9a5-1eb9-43d6-88ef-34780d8bab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:44.537814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 992/1984] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:44.543388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9aef-ce6f-4547-b06c-4c295227baad None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:44.558636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9aef-ce6f-4547-b06c-4c295227baad None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:44.569449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:44.570402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.571086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.571574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:44.572500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:44.573236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:44.577081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:44.595883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 993/1985] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:44.599457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea9a5-1eb9-43d6-88ef-34780d8bab63 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:44.611386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea9a5-1eb9-43d6-88ef-34780d8bab63 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:44.626617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:44.627433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.627719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.627993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:44.628655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:44.630615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:44.670519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:44.672591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:44.676247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 993/1986] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:44 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:03:44.689863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:44.705071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c062486-8b7b-46df-98cd-08d9c1e8ba55 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:44.843415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:44.844039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.844313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.844583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] PATH_INFO: `/v3/users/fd3415de15af449a9975b200d7182543` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:44.845825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3415de15af449a9975b200d7182543)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:44.847962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:44.873000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:44.873363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150620-1f61-413c-a99f-05a59120a32f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:44.882127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:44.883048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.883375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.883654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:44.884489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:44.888097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:44.899542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:44.911536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3415de15af449a9975b200d7182543'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.929232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3415de15af449a9975b200d7182543'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.942500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3415de15af449a9975b200d7182543'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.945783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3415de15af449a9975b200d7182543'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.946501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2df4cdc6-2637-4ebb-a884-a515a1457ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3415de15af449a9975b200d7182543'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:44.956154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 994/1987] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:44 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:44.956966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:44.959851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:44.975690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 994/1988] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:44 2022] DELETE /identity/v3/users/fd3415de15af449a9975b200d7182543 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:44.975916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fd0fd-ae1a-4da2-b354-928f260fe23c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:44.983391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:44.984337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:44.984770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.022882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:45.047068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:45.098591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:45.099390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:45.099773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:45.100178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.101026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:45.102842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:45.116659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 995/1989] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:45.120650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:45.134519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05855c90-2f05-4afd-bdbc-0d022768c41c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:45.142222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:45.143077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:45.143457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:45.143820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.144617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:45.146545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:45.161108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 996/1990] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:45.163447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 995/1991] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:45.168992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:45.173803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:45.175259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:45.185439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c503d1-d9f3-4093-a4bd-ce58da1afaf4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:45.192959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec34c6c-fed8-47bf-8724-1d9dfed99431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:45.193789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34c6c-fed8-47bf-8724-1d9dfed99431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:45.194180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34c6c-fed8-47bf-8724-1d9dfed99431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:45.194553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34c6c-fed8-47bf-8724-1d9dfed99431 admin admin] PATH_INFO: `/v3/projects/8548ab5328c84997bf7c17ac1112e79a/users/941d585e9c6e4400852d266afb8bda32/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.214686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec34c6c-fed8-47bf-8724-1d9dfed99431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8548ab5328c84997bf7c17ac1112e79a, user_id=941d585e9c6e4400852d266afb8bda32, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:45.218398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec34c6c-fed8-47bf-8724-1d9dfed99431 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:45.247181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 997/1992] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:45 2022] PUT /identity/v3/projects/8548ab5328c84997bf7c17ac1112e79a/users/941d585e9c6e4400852d266afb8bda32/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:45.260486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8f2d-7c5c-4ee8-9cf6-731200edf163 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:45.260486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8f2d-7c5c-4ee8-9cf6-731200edf163 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:45.266182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df9284-027e-4966-ad3a-e745fb4b5676 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:45.266697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8f2d-7c5c-4ee8-9cf6-731200edf163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.344640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-27be8f2d-7c5c-4ee8-9cf6-731200edf163 None None] MFA Rules not processed for user `941d585e9c6e4400852d266afb8bda32`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:45.346451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-27be8f2d-7c5c-4ee8-9cf6-731200edf163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:45.402862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:45.403704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:45.403875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:45.404155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.421833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:45.486217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 998/1993] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:45.490115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8f2d-7c5c-4ee8-9cf6-731200edf163 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:45.567546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:45.569122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:45.591439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:45.594990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 996/1994] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:03:45.643293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8f2d-7c5c-4ee8-9cf6-731200edf163 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:45.668958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:45.669937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:45.670322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:45.671711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.672474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:45.680143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:45.756440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 999/1995] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:45 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:45.763200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:45.785773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb8b5-b5ff-4fce-b106-cc35a1684c6c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:45.944569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:45.945338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:45.950948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:45.951373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:45.952231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:45.958041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:46.024348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 997/1996] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:45 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:46.025648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:46.042522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958acd5a-bec7-42c8-b2da-2e7ad1de1215 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:46.052279 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:46.054069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.054847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.057505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.058610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:46.063216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:46.098802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1000/1997] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:46.102876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:46.120367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f109cc7-c3c8-4aca-864f-b9a54580d720 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:46.128892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:46.131010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.131555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.131989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] PATH_INFO: `/v3/projects/9150b951211247e9b765d73db1cfa426/users/23a6d0b3aa2a4eb7be6e6cf3586e47ff/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.158341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150b951211247e9b765d73db1cfa426, user_id=23a6d0b3aa2a4eb7be6e6cf3586e47ff, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:46.167425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:46.211035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 998/1998] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:46 2022] PUT /identity/v3/projects/9150b951211247e9b765d73db1cfa426/users/23a6d0b3aa2a4eb7be6e6cf3586e47ff/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:46.215184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:46.256576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2689b-444e-4c92-9dc6-0386b04981f6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:46.372134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:46.373326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.373822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.374299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.375160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:46.377727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:46.393092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1001/1999] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:46.398141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:46.425684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32df5d-0ea0-4f37-b4e3-ab44eddc2f7e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:46.435450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b5cd1-376c-4e76-ac76-f56228130eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:46.436476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b5cd1-376c-4e76-ac76-f56228130eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.436926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b5cd1-376c-4e76-ac76-f56228130eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.437344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b5cd1-376c-4e76-ac76-f56228130eef admin admin] PATH_INFO: `/v3/projects/9150b951211247e9b765d73db1cfa426/users/23a6d0b3aa2a4eb7be6e6cf3586e47ff/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.440367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b5cd1-376c-4e76-ac76-f56228130eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150b951211247e9b765d73db1cfa426, user_id=23a6d0b3aa2a4eb7be6e6cf3586e47ff, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:46.443639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b5cd1-376c-4e76-ac76-f56228130eef admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:46.461585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 999/2000] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:46 2022] PUT /identity/v3/projects/9150b951211247e9b765d73db1cfa426/users/23a6d0b3aa2a4eb7be6e6cf3586e47ff/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:46.480504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:46.484736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:46.492534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.492865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.493112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.507249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e37de-6cc9-4ebc-9550-475b790cf7bc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:46.573027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] MFA Rules not processed for user `23a6d0b3aa2a4eb7be6e6cf3586e47ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:46.574463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:46.605408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:46.606335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.606610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.615285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] PATH_INFO: `/v3/projects/aae5b46f245c431ea0b992418d57c6db` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.617487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae5b46f245c431ea0b992418d57c6db)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:46.619637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:46.692626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae5b46f245c431ea0b992418d57c6db', 'request_id': 'req-9803a511-3f14-4f49-8985-191dc26f8268'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:46.694939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:46.703373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae5b46f245c431ea0b992418d57c6db', 'request_id': 'req-9803a511-3f14-4f49-8985-191dc26f8268'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:46.722128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae5b46f245c431ea0b992418d57c6db', 'request_id': 'req-9803a511-3f14-4f49-8985-191dc26f8268'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:46.726298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:46.752438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] The token cache is being invalidate because project aae5b46f245c431ea0b992418d57c6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:46.752776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:46.753837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9803a511-3f14-4f49-8985-191dc26f8268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:46.760264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1002/2001] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:46 2022] DELETE /identity/v3/projects/aae5b46f245c431ea0b992418d57c6db => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:46.761746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629fce7-966e-49dd-a827-9caab3e2c001 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.762195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629fce7-966e-49dd-a827-9caab3e2c001 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.763203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629fce7-966e-49dd-a827-9caab3e2c001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.790759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b629fce7-966e-49dd-a827-9caab3e2c001 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:46.792192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b629fce7-966e-49dd-a827-9caab3e2c001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:46.812341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1000/2002] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:46.829284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:46.831038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:46.891554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1003/2003] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:46.899728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1ccba-2faa-46eb-a03f-077cf49cd935 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.901572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1ccba-2faa-46eb-a03f-077cf49cd935 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.901697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1ccba-2faa-46eb-a03f-077cf49cd935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.937420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bbc1ccba-2faa-46eb-a03f-077cf49cd935 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:46.938748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bbc1ccba-2faa-46eb-a03f-077cf49cd935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:46.949486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1004/2004] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:46.954136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1ccba-2faa-46eb-a03f-077cf49cd935 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:46.959911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873283a-ae27-4e1b-8cbf-bb897b98ad02 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:46.966220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1ccba-2faa-46eb-a03f-077cf49cd935 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:46.971880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:46.972627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:46.973017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:46.973451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:46.974201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:46.974572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:46.976599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.000357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1005/2005] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:47.001398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:47.016740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e52798-c5e6-47b9-acd5-e1bf94782f3b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:47.039791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:47.040907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.041207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.041609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.042430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:47.045069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.071171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:47.071971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.072452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.072780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.101145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1006/2006] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:47 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:47.110383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:47.163048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:47.164924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.176135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1001/2007] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:03:47.196341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271de7-ece8-45c6-9a2f-b7219cafc785 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:47.203135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:47.203911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.204187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.204455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.205203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:47.207917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.243457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1007/2008] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:47 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:47.245161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:47.264982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662143-83b0-45c3-b418-4bd9252cfc8e service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:47.271188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:47.272931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.273281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.273665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.274391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:47.276261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.294978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1002/2009] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:47.296619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:47.312656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae4e7-15e4-4b37-b2b8-87f1b67db00a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:47.337511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572a05b-69cf-430f-9feb-22b381d0f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:47.338281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a05b-69cf-430f-9feb-22b381d0f918 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.339088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a05b-69cf-430f-9feb-22b381d0f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.339716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a05b-69cf-430f-9feb-22b381d0f918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.340608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572a05b-69cf-430f-9feb-22b381d0f918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:47.342493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572a05b-69cf-430f-9feb-22b381d0f918 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.370137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1008/2010] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:47.374352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:47.386510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184a2ee-3afb-4e75-91f2-0e78cfc614cf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:47.410259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:47.411271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.411753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.412252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] PATH_INFO: `/v3/projects/7ff19f67d8e845429dacf9ceea54a71a/users/62a6098a168b4950a99e41d19fd90384/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.436441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff19f67d8e845429dacf9ceea54a71a, user_id=62a6098a168b4950a99e41d19fd90384, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:47.439971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.461120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1003/2011] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:47 2022] PUT /identity/v3/projects/7ff19f67d8e845429dacf9ceea54a71a/users/62a6098a168b4950a99e41d19fd90384/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:47.475015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929673-b434-46ad-a892-3a69819f6a79 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.475306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929673-b434-46ad-a892-3a69819f6a79 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.475583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929673-b434-46ad-a892-3a69819f6a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.565253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c2929673-b434-46ad-a892-3a69819f6a79 None None] MFA Rules not processed for user `62a6098a168b4950a99e41d19fd90384`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:47.566747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c2929673-b434-46ad-a892-3a69819f6a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:47.588771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:47.681510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1009/2012] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:47.686201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:47.706095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:47.830510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a90bc-8089-4f1a-8917-9d6b470e7536 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:47.851655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:47.852188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:47.852541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:47.852828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:47.854637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:47.857709 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:47.902938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1004/2013] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:47 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:47.907801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929673-b434-46ad-a892-3a69819f6a79 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:47.926974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929673-b434-46ad-a892-3a69819f6a79 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:48.018772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:48.019639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.020186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.020839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.021735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:48.027177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:48.055099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:48.057013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:48.084581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1010/2014] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:47 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:48.085492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233426e-a42a-4f99-8288-fca2eae3db8b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:48.088675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:48.097703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:48.098368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.098646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.098918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] PATH_INFO: `/v3/users/941d585e9c6e4400852d266afb8bda32` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.100068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=941d585e9c6e4400852d266afb8bda32)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:48.108981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:48.120466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0ff69-6f90-4ade-966f-b74ca30f8190 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:48.135406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:48.138695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.139295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.139778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.141431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:48.147653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:48.181376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1011/2015] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:48.184079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:48.186510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941d585e9c6e4400852d266afb8bda32'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:48.197627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71bb22-b8e3-497a-b550-d20076560443 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:48.201935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941d585e9c6e4400852d266afb8bda32'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:48.211486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941d585e9c6e4400852d266afb8bda32'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:48.212322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:48.212477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941d585e9c6e4400852d266afb8bda32'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:48.213277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.213383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95d948a7-3d2b-4776-9bc8-f748a8fad74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941d585e9c6e4400852d266afb8bda32'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:48.213737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.218007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.221595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:48.224973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:48.252873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1005/2016] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:48 2022] DELETE /identity/v3/users/941d585e9c6e4400852d266afb8bda32 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:48.255103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1012/2017] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:48.259065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.259523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.259926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.260172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:48.266168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:48.295599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b382fc4-2790-4f64-9cda-c0b239918de1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:48.295819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:48.298096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:48.461291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1006/2018] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:48.464466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd85d8b-5dd4-4d21-a9b7-86e6bc897561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:48.466253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85d8b-5dd4-4d21-a9b7-86e6bc897561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.467754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85d8b-5dd4-4d21-a9b7-86e6bc897561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.468060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85d8b-5dd4-4d21-a9b7-86e6bc897561 admin admin] PATH_INFO: `/v3/projects/66c8823b590b408184c456945fe2a59e/users/03099a29019d410fa19b669bbcf0a231/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.489926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd85d8b-5dd4-4d21-a9b7-86e6bc897561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c8823b590b408184c456945fe2a59e, user_id=03099a29019d410fa19b669bbcf0a231, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:48.492596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:48.494903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:48.507407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd85d8b-5dd4-4d21-a9b7-86e6bc897561 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:48.517177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:48.531776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:48.539398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1013/2019] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:48 2022] PUT /identity/v3/projects/66c8823b590b408184c456945fe2a59e/users/03099a29019d410fa19b669bbcf0a231/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:48.552029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53593-7cb0-49d9-8e9e-26f78244c516 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.552342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53593-7cb0-49d9-8e9e-26f78244c516 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.552585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53593-7cb0-49d9-8e9e-26f78244c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.593616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-28e53593-7cb0-49d9-8e9e-26f78244c516 None None] MFA Rules not processed for user `03099a29019d410fa19b669bbcf0a231`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:48.595366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-28e53593-7cb0-49d9-8e9e-26f78244c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:48.620470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eaa90-132c-40f1-aa5e-8a0faf445071 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:48.689516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:48.690141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.690418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.690688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.728318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1014/2020] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:48.750469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53593-7cb0-49d9-8e9e-26f78244c516 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:48.823762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:48.825665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:48.836858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1007/2021] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:03:48.873573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53593-7cb0-49d9-8e9e-26f78244c516 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:48.880628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:48.881381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:48.881808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:48.882090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:48.882831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:48.884860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:48.919544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1015/2022] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:48 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:48.923592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:48.934540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d364f1-a2e8-4aa5-8552-a2e94a50d7a6 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.019162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.019884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.020650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.020964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.021745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.023789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.056517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1008/2023] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:48 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:49.061231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:49.074229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3106-79a7-4d90-bb68-7f05893d11e3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.080434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.081308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.081736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.082181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.082999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.085160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.103764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1016/2024] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:49.108829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:49.119622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:49.125186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85542976-2f3f-4503-abbf-b86e52277050 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.141785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.142842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.143194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.143533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] PATH_INFO: `/v3/projects/bcf4253b91404ea29e25771dd2d04dc5/users/c2d998b149da4b19967ab4a5cc7cbf64/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.173893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf4253b91404ea29e25771dd2d04dc5, user_id=c2d998b149da4b19967ab4a5cc7cbf64, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.176721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.193975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1009/2025] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:49 2022] PUT /identity/v3/projects/bcf4253b91404ea29e25771dd2d04dc5/users/c2d998b149da4b19967ab4a5cc7cbf64/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:49.198187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:49.224521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654dc7-c496-4b64-85d5-b1d968f015d9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.340150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.340827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.340913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.341331 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.341926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.344356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.345053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:49.347086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:49.347492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:49.361942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1017/2026] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:49.363208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:49.385311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50bda7-6879-4616-ae9d-ad330e5006cc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.392405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.393557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.393924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c576f3-ef9a-45b4-ab0c-02750507b82c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.394041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.394434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] PATH_INFO: `/v3/projects/8548ab5328c84997bf7c17ac1112e79a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.396227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8548ab5328c84997bf7c17ac1112e79a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.398780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.399988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d642fc-d727-4258-8da6-c573a92af7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.400699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d642fc-d727-4258-8da6-c573a92af7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.401028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d642fc-d727-4258-8da6-c573a92af7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.401406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d642fc-d727-4258-8da6-c573a92af7d9 admin admin] PATH_INFO: `/v3/projects/bcf4253b91404ea29e25771dd2d04dc5/users/c2d998b149da4b19967ab4a5cc7cbf64/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.404985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d642fc-d727-4258-8da6-c573a92af7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf4253b91404ea29e25771dd2d04dc5, user_id=c2d998b149da4b19967ab4a5cc7cbf64, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.417415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d642fc-d727-4258-8da6-c573a92af7d9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.442508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1018/2027] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:49 2022] PUT /identity/v3/projects/bcf4253b91404ea29e25771dd2d04dc5/users/c2d998b149da4b19967ab4a5cc7cbf64/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:49.444788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.445698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.445983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.479631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] MFA Rules not processed for user `c2d998b149da4b19967ab4a5cc7cbf64`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:49.480435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:49.506741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8548ab5328c84997bf7c17ac1112e79a', 'request_id': 'req-5ca58532-adaa-4a04-9970-fe01157d59d9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.523087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8548ab5328c84997bf7c17ac1112e79a', 'request_id': 'req-5ca58532-adaa-4a04-9970-fe01157d59d9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.537038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8548ab5328c84997bf7c17ac1112e79a', 'request_id': 'req-5ca58532-adaa-4a04-9970-fe01157d59d9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.566940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] The token cache is being invalidate because project 8548ab5328c84997bf7c17ac1112e79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:49.567237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.568681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.572081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1010/2028] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:49 2022] DELETE /identity/v3/projects/8548ab5328c84997bf7c17ac1112e79a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:49.576719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:49.578522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:49.584266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1019/2029] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:49.592268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:49.601041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:49.664302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58532-adaa-4a04-9970-fe01157d59d9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.671081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.671732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.672012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.672286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] PATH_INFO: `/v3/users/23a6d0b3aa2a4eb7be6e6cf3586e47ff` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.674149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a6d0b3aa2a4eb7be6e6cf3586e47ff)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.675752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.680485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d56b-c5a1-4519-bbc1-adfaf10c7a70 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:49.685539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:49.686171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:49.686443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:49.686710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:49.689189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:49.737075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a6d0b3aa2a4eb7be6e6cf3586e47ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.761193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a6d0b3aa2a4eb7be6e6cf3586e47ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.762993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:49.775032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:49.775472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a6d0b3aa2a4eb7be6e6cf3586e47ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.776703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:49.776912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a6d0b3aa2a4eb7be6e6cf3586e47ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.778043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fbecf080-06b4-473c-a7c8-d0475634498a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a6d0b3aa2a4eb7be6e6cf3586e47ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:49.788758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1020/2030] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:03:49.796520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1011/2031] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:49 2022] DELETE /identity/v3/users/23a6d0b3aa2a4eb7be6e6cf3586e47ff => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:50.238676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:50.273134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47df30-2c2d-401d-9c4b-ed80d9b09e58 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:50.298219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:50.344735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:50.345416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.345669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.345965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] PATH_INFO: `/v3/projects/9150b951211247e9b765d73db1cfa426` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.347206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9150b951211247e9b765d73db1cfa426)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:50.349426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:50.399346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9150b951211247e9b765d73db1cfa426', 'request_id': 'req-e96d22ba-9891-4532-8dcc-5371208b557c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:50.405550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9150b951211247e9b765d73db1cfa426', 'request_id': 'req-e96d22ba-9891-4532-8dcc-5371208b557c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:50.414421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9150b951211247e9b765d73db1cfa426', 'request_id': 'req-e96d22ba-9891-4532-8dcc-5371208b557c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:50.426057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] The token cache is being invalidate because project 9150b951211247e9b765d73db1cfa426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:50.426353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:50.427003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e96d22ba-9891-4532-8dcc-5371208b557c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:50.428602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1021/2032] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:50 2022] DELETE /identity/v3/projects/9150b951211247e9b765d73db1cfa426 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:50.433811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be95b2-ac5f-4015-b740-6e7eff5fb601 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.434219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be95b2-ac5f-4015-b740-6e7eff5fb601 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.434553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be95b2-ac5f-4015-b740-6e7eff5fb601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.454981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-73be95b2-ac5f-4015-b740-6e7eff5fb601 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:50.456278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-73be95b2-ac5f-4015-b740-6e7eff5fb601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:50.515979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1012/2033] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:50.525873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172438-63ee-434b-8a5d-17d2393215ba None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.526391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172438-63ee-434b-8a5d-17d2393215ba None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.526729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09172438-63ee-434b-8a5d-17d2393215ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.548649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-09172438-63ee-434b-8a5d-17d2393215ba None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:50.550027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-09172438-63ee-434b-8a5d-17d2393215ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:50.559928 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1022/2034] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:50.564359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be95b2-ac5f-4015-b740-6e7eff5fb601 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:50.575061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be95b2-ac5f-4015-b740-6e7eff5fb601 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:50.579890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:50.580503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.580783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.581076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.581732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:50.582036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:50.583650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:50.596076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1013/2035] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:50.600501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172438-63ee-434b-8a5d-17d2393215ba None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:50.612150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09172438-63ee-434b-8a5d-17d2393215ba None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:50.618211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:50.618914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.619244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.619575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.620283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:50.622730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:50.659201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1023/2036] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:50 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:50.662941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:50.673250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c42496-19b1-4ed3-9a8a-53b23719b943 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:50.761370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:50.762105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.762388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.762662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.763418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:50.765408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:50.789122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1014/2037] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:50 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:50.794133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:50.804213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae059eb3-b443-4e1a-b03b-61ebeeddd01d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:50.809118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:50.809689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.810056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.810393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.811167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:50.812905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:50.826923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1024/2038] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:50.828135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:50.841825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b97232-78ec-465f-9ea8-3791fd7522ad admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:50.848030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7a9c-97d3-4baa-bac8-2b2e7c5833c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:50.848723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7a9c-97d3-4baa-bac8-2b2e7c5833c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.849115 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7a9c-97d3-4baa-bac8-2b2e7c5833c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.849450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7a9c-97d3-4baa-bac8-2b2e7c5833c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.850277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7a9c-97d3-4baa-bac8-2b2e7c5833c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:50.853564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7a9c-97d3-4baa-bac8-2b2e7c5833c9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:50.872081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1015/2039] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:50.876836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:50.889103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d972e3-5d7b-47b3-bb09-84898710516f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:50.894111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:50.894990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.895125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.895403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] PATH_INFO: `/v3/projects/6f70450e510542908b9b96686fc3e37b/users/bbdfcfb8efc543528de1c37e66a0a8ba/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.910662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f70450e510542908b9b96686fc3e37b, user_id=bbdfcfb8efc543528de1c37e66a0a8ba, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:50.913278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:50.928755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1025/2040] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:50 2022] PUT /identity/v3/projects/6f70450e510542908b9b96686fc3e37b/users/bbdfcfb8efc543528de1c37e66a0a8ba/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:50.939456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:50.939741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:50.940199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:50.968545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] MFA Rules not processed for user `bbdfcfb8efc543528de1c37e66a0a8ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:50.969859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:51.010771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:51.039753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1016/2041] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:51.051483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:51.053475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:51.115007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bda15b-de49-4c82-87e5-0e84670f64f9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:51.119286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:51.119905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:51.120210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:51.120476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:51.126489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:51.130774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:51.132252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:51.143683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1026/2042] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:51.546572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:51.548556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:51.565993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93cb1-fc6b-4223-a170-f4de7821c42a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:51.570319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:51.570959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:51.571286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:51.571494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:51.573457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:51.662941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:51.664417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:51.675478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1017/2043] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:52.310324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:52.326151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e179ae-e4d1-4fa1-8698-2560b2a996a9 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:52.330925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a230a2-280e-4735-b42c-8aa9749241e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:52.331726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a230a2-280e-4735-b42c-8aa9749241e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:52.332003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a230a2-280e-4735-b42c-8aa9749241e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:52.332280 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a230a2-280e-4735-b42c-8aa9749241e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:52.334396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b6a230a2-280e-4735-b42c-8aa9749241e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:52.418883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a230a2-280e-4735-b42c-8aa9749241e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:52.421442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a230a2-280e-4735-b42c-8aa9749241e8 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:52.432960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1027/2044] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:56.548946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:56.553651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:56.629728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe4a3c-57cc-4010-af77-30610eb5a136 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:56.634420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:56.635632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:56.635632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:56.635876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] PATH_INFO: `/v3/users/62a6098a168b4950a99e41d19fd90384` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:56.637555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a6098a168b4950a99e41d19fd90384)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:56.640093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:56.699804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a6098a168b4950a99e41d19fd90384'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:56.714060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a6098a168b4950a99e41d19fd90384'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:56.722188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a6098a168b4950a99e41d19fd90384'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:56.723043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a6098a168b4950a99e41d19fd90384'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:56.723655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a6098a168b4950a99e41d19fd90384'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:56.728044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:56.755301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1018/2045] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:56 2022] DELETE /identity/v3/users/62a6098a168b4950a99e41d19fd90384 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:56.759924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:56.762400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:56.764086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:56.791008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:56.792629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:56.813615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:56.815109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:56.878901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1028/2046] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:56.886210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:56.888178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:56.902101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696951-6290-49da-b2d7-1d920cf679b5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:56.908523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:56.909221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:56.909502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:56.909777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] PATH_INFO: `/v3/users/bbdfcfb8efc543528de1c37e66a0a8ba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:56.910967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbdfcfb8efc543528de1c37e66a0a8ba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:56.913002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:56.965848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c220-3b91-4748-ae5c-5da90018a667 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:56.970075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4951103-0b15-4ed2-be6c-f403ff5cfcff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:56.970965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbdfcfb8efc543528de1c37e66a0a8ba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:56.971083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4951103-0b15-4ed2-be6c-f403ff5cfcff service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:56.971478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4951103-0b15-4ed2-be6c-f403ff5cfcff service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:56.971772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4951103-0b15-4ed2-be6c-f403ff5cfcff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:56.983123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4951103-0b15-4ed2-be6c-f403ff5cfcff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:56.985100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4951103-0b15-4ed2-be6c-f403ff5cfcff service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:56.990109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbdfcfb8efc543528de1c37e66a0a8ba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:56.997981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1029/2047] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:03:57.000073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbdfcfb8efc543528de1c37e66a0a8ba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.000859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbdfcfb8efc543528de1c37e66a0a8ba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.001820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbdfcfb8efc543528de1c37e66a0a8ba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.024946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1019/2048] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:56 2022] DELETE /identity/v3/users/bbdfcfb8efc543528de1c37e66a0a8ba => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:03:57.026637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:57.026923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:57.027287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:57.063261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:57.065410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:57.114849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:57.168248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1030/2049] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:57.180454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:57.183216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:57.258016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89901a-adcc-45d7-bc05-56ef07fe1ccd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:57.261783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:57.262562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:57.262904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:57.263232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:57.273858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:57.275339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:57.289207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1020/2050] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:57.681031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:57.682709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:57.706418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9ab77-833e-4395-ac96-0050a40cf9c7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:57.719366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:57.719614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:57.719705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:57.719972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] PATH_INFO: `/v3/projects/7ff19f67d8e845429dacf9ceea54a71a` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:57.727625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff19f67d8e845429dacf9ceea54a71a)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:57.729869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:57.754122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:57.755658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:57.773363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09eccce-101d-407b-8b24-b4b096ec2b71 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:57.783391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:57.784055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:57.784424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:57.784694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] PATH_INFO: `/v3/projects/6f70450e510542908b9b96686fc3e37b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:57.786342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f70450e510542908b9b96686fc3e37b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:57.788443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:57.815780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:57.871396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff19f67d8e845429dacf9ceea54a71a', 'request_id': 'req-98a5c0a9-fb35-4c69-bee0-fdff816027da'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.877534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f70450e510542908b9b96686fc3e37b', 'request_id': 'req-628122d8-9553-4958-9daf-5a18305536f5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.880432 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff19f67d8e845429dacf9ceea54a71a', 'request_id': 'req-98a5c0a9-fb35-4c69-bee0-fdff816027da'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.884083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f70450e510542908b9b96686fc3e37b', 'request_id': 'req-628122d8-9553-4958-9daf-5a18305536f5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.890551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f70450e510542908b9b96686fc3e37b', 'request_id': 'req-628122d8-9553-4958-9daf-5a18305536f5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.892116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff19f67d8e845429dacf9ceea54a71a', 'request_id': 'req-98a5c0a9-fb35-4c69-bee0-fdff816027da'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.909811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] The token cache is being invalidate because project 6f70450e510542908b9b96686fc3e37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:57.909986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] The token cache is being invalidate because project 7ff19f67d8e845429dacf9ceea54a71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:57.909986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.910181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.910649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98a5c0a9-fb35-4c69-bee0-fdff816027da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.910800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:57.912638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1031/2052] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:57 2022] DELETE /identity/v3/projects/7ff19f67d8e845429dacf9ceea54a71a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:57.912787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1021/2052] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:57 2022] DELETE /identity/v3/projects/6f70450e510542908b9b96686fc3e37b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:57.916596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:57.918873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:57.919083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2fb9-12a6-40c0-bd61-b12fac961acc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:57.919702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2fb9-12a6-40c0-bd61-b12fac961acc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:57.920475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2fb9-12a6-40c0-bd61-b12fac961acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:57.944710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cc1b2fb9-12a6-40c0-bd61-b12fac961acc None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:57.945979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cc1b2fb9-12a6-40c0-bd61-b12fac961acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:58.039329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628122d8-9553-4958-9daf-5a18305536f5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.044921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.045918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.045918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.046098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] PATH_INFO: `/v3/users/03099a29019d410fa19b669bbcf0a231` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.047424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] RBAC: Authorizing `identity:delete_user(user_id=03099a29019d410fa19b669bbcf0a231)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.049555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.058365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1032/2053] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:58.066683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d675-745e-42b5-af2d-9438880eddc8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.066984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d675-745e-42b5-af2d-9438880eddc8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.067230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d675-745e-42b5-af2d-9438880eddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.098913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3573d675-745e-42b5-af2d-9438880eddc8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:58.100576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3573d675-745e-42b5-af2d-9438880eddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:58.109687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1033/2054] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:58.116073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03099a29019d410fa19b669bbcf0a231'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.133700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d675-745e-42b5-af2d-9438880eddc8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.137013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03099a29019d410fa19b669bbcf0a231'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.149619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03099a29019d410fa19b669bbcf0a231'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.150805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03099a29019d410fa19b669bbcf0a231'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.151555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d675-745e-42b5-af2d-9438880eddc8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.152073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03099a29019d410fa19b669bbcf0a231'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.164318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.165627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.166159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.166780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.167939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:58.168457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.170885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.174771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1022/2055] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:57 2022] DELETE /identity/v3/users/03099a29019d410fa19b669bbcf0a231 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:58.192447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1034/2056] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:58.197303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.200281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:58.250255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:58.357098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19bf39-61f3-4a4b-b898-935b8c5e22de admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.364358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.368088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.368494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.368913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.369814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.372158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.433480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1023/2057] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:58 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:58.435178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.449918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4a58e-ce19-4d38-b414-ab89b5d10b90 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.516086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:58.554667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.555580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.555969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.556364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.557136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.562730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.613430 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1035/2058] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:03:58 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:03:58.616703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.630000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f510eff-0585-4768-99bf-357fffc51703 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.645817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.646504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.646750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.647024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.647748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.650112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.665692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1024/2059] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:03:58.669661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.685640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c2ac-229e-4fe4-8d2f-d4bd2410674b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.700206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.701019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.701375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.702098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.703237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.705351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.737945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1036/2060] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:03:58.742497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.755322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.757648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:58.762977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7bc5c-b153-48bc-b95b-4cc7c0ee5afd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.770615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d229c00-7c47-4e1c-b81a-52f82f93ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.771315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d229c00-7c47-4e1c-b81a-52f82f93ebee admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.771602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d229c00-7c47-4e1c-b81a-52f82f93ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.771884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d229c00-7c47-4e1c-b81a-52f82f93ebee admin admin] PATH_INFO: `/v3/projects/515154d451974fc9926ee623e4e02a50/users/6c3f1b1f89434d4b8bc4750b94205a25/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.793417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a49803-4d0f-47e6-a546-893e046d3fab admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:58.805003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:58.805182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d229c00-7c47-4e1c-b81a-52f82f93ebee admin admin] RBAC: Authorizing `identity:create_grant(project_id=515154d451974fc9926ee623e4e02a50, user_id=6c3f1b1f89434d4b8bc4750b94205a25, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.806046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.808369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d229c00-7c47-4e1c-b81a-52f82f93ebee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.809760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.810093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] PATH_INFO: `/v3/projects/66c8823b590b408184c456945fe2a59e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.815542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c8823b590b408184c456945fe2a59e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:58.817780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:58.832851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1025/2061] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:03:58 2022] PUT /identity/v3/projects/515154d451974fc9926ee623e4e02a50/users/6c3f1b1f89434d4b8bc4750b94205a25/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:58.843018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:58.843660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:58.844168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:58.884695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] MFA Rules not processed for user `6c3f1b1f89434d4b8bc4750b94205a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:58.886063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:58.900990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c8823b590b408184c456945fe2a59e', 'request_id': 'req-c3b3c273-91e7-4ca5-99cd-f074de983151'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.908724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c8823b590b408184c456945fe2a59e', 'request_id': 'req-c3b3c273-91e7-4ca5-99cd-f074de983151'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.924872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c8823b590b408184c456945fe2a59e', 'request_id': 'req-c3b3c273-91e7-4ca5-99cd-f074de983151'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.946746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] The token cache is being invalidate because project 66c8823b590b408184c456945fe2a59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:58.946955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.947960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:58.952577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1037/2062] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:58 2022] DELETE /identity/v3/projects/66c8823b590b408184c456945fe2a59e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:58.953680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:58.955758 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:58.987530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1026/2063] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:58.995639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.010579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.049035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3c273-91e7-4ca5-99cd-f074de983151 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.053845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.054537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.054813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.055106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] PATH_INFO: `/v3/users/c2d998b149da4b19967ab4a5cc7cbf64` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.056254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d998b149da4b19967ab4a5cc7cbf64)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.060391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.121916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8b69-ff18-421a-bdf1-b39c909fd8f5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.127612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.127815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.128223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.128499 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.152976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:59.161159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.162776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.165643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d998b149da4b19967ab4a5cc7cbf64'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.177082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d998b149da4b19967ab4a5cc7cbf64'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.185311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1027/2064] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:03:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:03:59.186982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.189017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.199828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:59.203784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d998b149da4b19967ab4a5cc7cbf64'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.205286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d998b149da4b19967ab4a5cc7cbf64'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.217191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db40dd-2f5d-4725-8018-ab7596b22021 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.227784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.228717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.229037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.229423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] PATH_INFO: `/v3/users/f077b9f8c63d4b75bf5290d32de393d7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.231077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f077b9f8c63d4b75bf5290d32de393d7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.234537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.238282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d998b149da4b19967ab4a5cc7cbf64'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.247733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1038/2065] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:58 2022] DELETE /identity/v3/users/c2d998b149da4b19967ab4a5cc7cbf64 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:59.311807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f077b9f8c63d4b75bf5290d32de393d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.334378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f077b9f8c63d4b75bf5290d32de393d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.343798 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f077b9f8c63d4b75bf5290d32de393d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.344760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f077b9f8c63d4b75bf5290d32de393d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.345412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f077b9f8c63d4b75bf5290d32de393d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.368835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1028/2066] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:03:59 2022] DELETE /identity/v3/users/f077b9f8c63d4b75bf5290d32de393d7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:59.589533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.590652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.591253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.592335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.686799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890db808-4860-4020-b757-9c606e21a706 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.691948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.692608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.693000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.693290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] PATH_INFO: `/v3/projects/bcf4253b91404ea29e25771dd2d04dc5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.694507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf4253b91404ea29e25771dd2d04dc5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.695833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9268256-ab5f-43ec-a2cf-1fc515b86b4c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.696506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.700717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.701681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.702033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.702474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] PATH_INFO: `/v3/projects/0dedcbca857942808845fb7039a16aaf` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.703903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dedcbca857942808845fb7039a16aaf)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.706503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.755857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf4253b91404ea29e25771dd2d04dc5', 'request_id': 'req-31ffedfe-ec9d-4638-829f-1cb5233ce120'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.760319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dedcbca857942808845fb7039a16aaf', 'request_id': 'req-839b27bc-e224-4eb8-b99e-e7760fb9adaf'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.763022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf4253b91404ea29e25771dd2d04dc5', 'request_id': 'req-31ffedfe-ec9d-4638-829f-1cb5233ce120'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.767063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dedcbca857942808845fb7039a16aaf', 'request_id': 'req-839b27bc-e224-4eb8-b99e-e7760fb9adaf'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.769454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf4253b91404ea29e25771dd2d04dc5', 'request_id': 'req-31ffedfe-ec9d-4638-829f-1cb5233ce120'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.775942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dedcbca857942808845fb7039a16aaf', 'request_id': 'req-839b27bc-e224-4eb8-b99e-e7760fb9adaf'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.785085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] The token cache is being invalidate because project bcf4253b91404ea29e25771dd2d04dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:59.785373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.785998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-31ffedfe-ec9d-4638-829f-1cb5233ce120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.787523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1029/2067] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:59 2022] DELETE /identity/v3/projects/bcf4253b91404ea29e25771dd2d04dc5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:59.788535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] The token cache is being invalidate because project 0dedcbca857942808845fb7039a16aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:03:59.788929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.789580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-839b27bc-e224-4eb8-b99e-e7760fb9adaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:03:59.795691 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1039/2068] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:03:59 2022] DELETE /identity/v3/projects/0dedcbca857942808845fb7039a16aaf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:03:59.795849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cba75-5435-485c-b943-243662c73fcb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.795849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cba75-5435-485c-b943-243662c73fcb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.795849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cba75-5435-485c-b943-243662c73fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.796940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea334d1-3b16-4c96-9c4b-066f0f558680 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.797224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea334d1-3b16-4c96-9c4b-066f0f558680 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.797496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea334d1-3b16-4c96-9c4b-066f0f558680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.803876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:59.817034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d54cba75-5435-485c-b943-243662c73fcb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:59.817984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-eea334d1-3b16-4c96-9c4b-066f0f558680 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:59.818838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d54cba75-5435-485c-b943-243662c73fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.819218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-eea334d1-3b16-4c96-9c4b-066f0f558680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.864314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:59.881013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1030/2069] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:59.884337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1040/2070] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:59.889289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f1e7-7373-4a6e-a186-941ce350b32e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.889561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f1e7-7373-4a6e-a186-941ce350b32e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.889833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f1e7-7373-4a6e-a186-941ce350b32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.892381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f7ffe-a2d7-43a4-829c-f54ac765e67b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.892665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f7ffe-a2d7-43a4-829c-f54ac765e67b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.892973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f7ffe-a2d7-43a4-829c-f54ac765e67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.912231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4648f1e7-7373-4a6e-a186-941ce350b32e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:59.913488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4648f1e7-7373-4a6e-a186-941ce350b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.913594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-331f7ffe-a2d7-43a4-829c-f54ac765e67b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:03:59.914789 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-331f7ffe-a2d7-43a4-829c-f54ac765e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:03:59.922887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1031/2071] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:03:59.923054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1041/2072] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:03:59.927445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f7ffe-a2d7-43a4-829c-f54ac765e67b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.927595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648f1e7-7373-4a6e-a186-941ce350b32e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.937245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f7ffe-a2d7-43a4-829c-f54ac765e67b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.941919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.942526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.942802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.943072 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.943716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:59.944013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.945642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.949331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648f1e7-7373-4a6e-a186-941ce350b32e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.955494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.956148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.956424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.956696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.960785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1042/2073] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:03:59.960995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:03:59.960995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.960995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.961790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.971392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a466c48-587c-414c-a1c6-3dfc01d5000b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.975629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1032/2074] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:03:59.975993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.976567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.976828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:03:59.976933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.977133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.977769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.979665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:03:59.987818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6137-3752-433e-9912-c4ebe3dab914 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:03:59.992589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:03:59.993217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:03:59.993500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:03:59.993904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:03:59.994530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:03:59.996425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.014956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1043/2075] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:59 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:00.016030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.031602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1033/2076] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:03:59 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:00.035921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.101010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a07c-2cfc-4e1b-a516-629ba7cf145e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.124705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7699e1-0694-44f9-90b6-998709f6dc74 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.130925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.132204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.132546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.132918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.134022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.136386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.162825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1034/2077] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:00 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:00.167815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.180567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348bde8-d3ee-4d93-ba8d-45333f15cd55 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.200286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.201128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.201610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.201898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.202578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.202696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.203286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.203568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.203836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.204506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.204620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.206421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.232984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1044/2078] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:00 2022] POST /identity/v3/users => generated 282 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:00.235535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1035/2079] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:00.236470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.236925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.247633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d9473-ea24-456d-87c2-ad25c395235f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.257560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.257741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe97b01-3f62-4f15-b778-ac5e3166ea15 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.258201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.258551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.258917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.259766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.261723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.262736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.263474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.264634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.264771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.265507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.267053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.275682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1036/2080] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:00.280000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.290127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004e25-9e40-45a7-8442-fc88dbbda6dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.292843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1045/2081] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:04:00.294977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.295477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1372d14-302e-433d-b2f2-f91309f57fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.296305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372d14-302e-433d-b2f2-f91309f57fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.296576 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372d14-302e-433d-b2f2-f91309f57fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.297004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372d14-302e-433d-b2f2-f91309f57fa8 admin admin] PATH_INFO: `/v3/projects/bfea94ce67584900b78b9ec6fc855408/users/c2e81cd348b44286b43a6662ee51114e/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.304823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73f87-2aab-4cd3-9286-a15dd6bc69e4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.309897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.310932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.311232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.311498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.312266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.313862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.314074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1372d14-302e-433d-b2f2-f91309f57fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfea94ce67584900b78b9ec6fc855408, user_id=c2e81cd348b44286b43a6662ee51114e, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.317645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1372d14-302e-433d-b2f2-f91309f57fa8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.326537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1046/2082] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:04:00.330869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.334628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1037/2083] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:00 2022] PUT /identity/v3/projects/bfea94ce67584900b78b9ec6fc855408/users/c2e81cd348b44286b43a6662ee51114e/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:04:00.340955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc902098-e76d-4d0b-9583-0d670c8dc1f2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.345184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9327c-2cac-40ba-9589-1271216a6448 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.345467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9327c-2cac-40ba-9589-1271216a6448 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.345787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9327c-2cac-40ba-9589-1271216a6448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.357984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:00.361689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:00.377526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23a9327c-2cac-40ba-9589-1271216a6448 None None] MFA Rules not processed for user `c2e81cd348b44286b43a6662ee51114e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:00.378805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23a9327c-2cac-40ba-9589-1271216a6448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:00.403974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158133-0b48-46de-893c-8b7d983a4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.404828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158133-0b48-46de-893c-8b7d983a4e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.405099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158133-0b48-46de-893c-8b7d983a4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.405366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158133-0b48-46de-893c-8b7d983a4e78 admin admin] PATH_INFO: `/v3/projects/79497132eb19421faa618daad9696aa0/users/bedb6c653e34443c9a4742cae6b74588/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.420373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158133-0b48-46de-893c-8b7d983a4e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79497132eb19421faa618daad9696aa0, user_id=bedb6c653e34443c9a4742cae6b74588, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.423133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158133-0b48-46de-893c-8b7d983a4e78 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.437473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1047/2084] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:00 2022] PUT /identity/v3/projects/79497132eb19421faa618daad9696aa0/users/bedb6c653e34443c9a4742cae6b74588/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:04:00.444721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1038/2085] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:04:00.449054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada37bf-037e-4cb3-8d25-38d311ef396f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.449191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9327c-2cac-40ba-9589-1271216a6448 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.449384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada37bf-037e-4cb3-8d25-38d311ef396f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.449708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada37bf-037e-4cb3-8d25-38d311ef396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.460740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9327c-2cac-40ba-9589-1271216a6448 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.478874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2ada37bf-037e-4cb3-8d25-38d311ef396f None None] MFA Rules not processed for user `bedb6c653e34443c9a4742cae6b74588`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:00.480093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ada37bf-037e-4cb3-8d25-38d311ef396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:00.520842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.521375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.521628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.521893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.522517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.524720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.545465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1048/2086] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:04:00.552046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1039/2087] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:00 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:00.555958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada37bf-037e-4cb3-8d25-38d311ef396f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.559669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.561638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:00.567182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada37bf-037e-4cb3-8d25-38d311ef396f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.625236 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32aa37-0e15-4061-bb8c-d4578bcecf53 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.634011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.635017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.635308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.635674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.639487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.640108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.640385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.640651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.641336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.643325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.679163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:00.689786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1049/2088] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:00 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:00.693515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.705251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9f21f-146c-40b6-b319-b3c385d2ae36 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.711233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.711967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.712229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.712505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.713109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.713230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.714659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.714957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.726936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1040/2089] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:04:00.731805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1050/2090] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:04:00.738026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.753639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7376b0-1033-455d-9feb-ab7432f8f2ed service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.762290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.762976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.763254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.763818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] PATH_INFO: `/v3/projects/9e9dffc005af4788baff4c349fec4b51/users/ecca297cf7c14fe297d583e2481b158b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.781379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9dffc005af4788baff4c349fec4b51, user_id=ecca297cf7c14fe297d583e2481b158b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.785353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.808290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.809309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1041/2091] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:00 2022] PUT /identity/v3/projects/9e9dffc005af4788baff4c349fec4b51/users/ecca297cf7c14fe297d583e2481b158b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:00.820628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ad2c5-25cd-4e14-bc9e-fbc04050620c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.831158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:00.913939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a1c4-89ed-45f1-82be-6627312f6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.915082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a1c4-89ed-45f1-82be-6627312f6ade admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.915656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a1c4-89ed-45f1-82be-6627312f6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.916117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a1c4-89ed-45f1-82be-6627312f6ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.917799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a1c4-89ed-45f1-82be-6627312f6ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.920740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a1c4-89ed-45f1-82be-6627312f6ade admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.936286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1051/2092] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:00.940700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:00.959043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f00b7-ebc3-4ff9-89c0-eaa4ad7b7051 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:00.965384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:00.966209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:00.966957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:00.967309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] PATH_INFO: `/v3/projects/9e9dffc005af4788baff4c349fec4b51/users/ecca297cf7c14fe297d583e2481b158b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:00.969980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9dffc005af4788baff4c349fec4b51, user_id=ecca297cf7c14fe297d583e2481b158b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:00.973688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:00.991195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1042/2093] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:00 2022] PUT /identity/v3/projects/9e9dffc005af4788baff4c349fec4b51/users/ecca297cf7c14fe297d583e2481b158b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:01.004221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86af8-84fc-4a58-983d-36684728d757 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:01.004510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86af8-84fc-4a58-983d-36684728d757 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:01.004790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86af8-84fc-4a58-983d-36684728d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:01.057124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-06e86af8-84fc-4a58-983d-36684728d757 None None] MFA Rules not processed for user `ecca297cf7c14fe297d583e2481b158b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:01.058443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-06e86af8-84fc-4a58-983d-36684728d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:01.157940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1052/2094] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:01.172212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:01.239942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283269a-a5f8-4da2-a90e-4c346a776ddf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:01.243778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:01.244405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:01.244680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:01.244983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:01.262994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:01.265447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:01.277286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1043/2095] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:01.694493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e86af8-84fc-4a58-983d-36684728d757 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:01.704164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e86af8-84fc-4a58-983d-36684728d757 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:01.709009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecca297cf7c14fe297d583e2481b158b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9dffc005af4788baff4c349fec4b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:01.709652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:01.709953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:01.710228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:01.710884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:01.711187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:01.712780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:01.725652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1053/2096] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:04:01.729588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:01.739669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aecfd-594f-403f-a2cb-eb929f18bed7 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:01.744558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecca297cf7c14fe297d583e2481b158b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9dffc005af4788baff4c349fec4b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:01.745191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:01.745475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:01.745755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:01.746431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:01.748431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:01.780859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1044/2097] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:01 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:01.783276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:01.794069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184734c-a9ed-47e2-adfa-9ac4526e8289 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:01.850434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecca297cf7c14fe297d583e2481b158b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9dffc005af4788baff4c349fec4b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:01.851067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:01.851360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:01.851617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:01.852262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:01.852558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:01.854315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:01.870865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1054/2098] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:04:01.906235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:01.916673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfeb70-ee35-4f72-9fa3-c2a20f217ce6 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:01.921574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecca297cf7c14fe297d583e2481b158b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e9dffc005af4788baff4c349fec4b51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:01.922247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:01.922526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:01.922796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] PATH_INFO: `/v3/projects/7bee430a822744959de641bcd4401622` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:01.924027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7bee430a822744959de641bcd4401622)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:01.926020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:01.978363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bee430a822744959de641bcd4401622', 'request_id': 'req-6d0b126b-a469-48b9-8df0-2ca61050a1b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:01.985911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bee430a822744959de641bcd4401622', 'request_id': 'req-6d0b126b-a469-48b9-8df0-2ca61050a1b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:01.992825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bee430a822744959de641bcd4401622', 'request_id': 'req-6d0b126b-a469-48b9-8df0-2ca61050a1b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.006399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] The token cache is being invalidate because project 7bee430a822744959de641bcd4401622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:02.006692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.007348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6d0b126b-a469-48b9-8df0-2ca61050a1b4 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.009129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1045/2099] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:01 2022] DELETE /identity/v3/projects/7bee430a822744959de641bcd4401622 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:02.238069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:02.240006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:02.263810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:02.323105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23cad9-70f4-4dfe-b43e-8e11d8905b34 tempest-VolumeQuotaClassesTest-1147113297 tempest-VolumeQuotaClassesTest-1147113297-project-admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:02.412482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:02.413576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:02.424824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:02.424824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] PATH_INFO: `/v3/users/c2e81cd348b44286b43a6662ee51114e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:02.428911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e81cd348b44286b43a6662ee51114e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:02.430906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:02.540698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e81cd348b44286b43a6662ee51114e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.541422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:02.541952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:02.542353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:02.550128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e81cd348b44286b43a6662ee51114e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.550524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:02.563323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e81cd348b44286b43a6662ee51114e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.565479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e81cd348b44286b43a6662ee51114e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.569682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] MFA Rules not processed for user `59d57d78b9c14b859009f8ff71a00c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:02.572371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:02.595185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6ebab821-2c9c-4a37-9291-f94c90bb42bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e81cd348b44286b43a6662ee51114e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:02.604853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1055/2100] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:02 2022] DELETE /identity/v3/users/c2e81cd348b44286b43a6662ee51114e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:02.617014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:02.617014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:02.617014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:02.637931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:02.639195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:02.679872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1046/2101] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:02.712827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:02.758989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1056/2102] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:02.765815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:02.768234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:02.845618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4148-1c64-4334-a874-c8ff9eba79e1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:02.909617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:02.913532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:02.913826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:02.914138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:02.927555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:02.929244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:02.940087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1047/2103] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:03.413369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:03.413369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:03.438427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dce15-009e-43a4-b702-6ff7c93d8a21 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:03.444375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:03.446714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:03.447834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:03.449158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] PATH_INFO: `/v3/projects/bfea94ce67584900b78b9ec6fc855408` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:03.451677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfea94ce67584900b78b9ec6fc855408)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:03.454727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:03.517188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfea94ce67584900b78b9ec6fc855408', 'request_id': 'req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.523235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfea94ce67584900b78b9ec6fc855408', 'request_id': 'req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.533001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfea94ce67584900b78b9ec6fc855408', 'request_id': 'req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.545154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] The token cache is being invalidate because project bfea94ce67584900b78b9ec6fc855408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:03.545859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.546619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.548712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1057/2104] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:03 2022] DELETE /identity/v3/projects/bfea94ce67584900b78b9ec6fc855408 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:03.553070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:03.564403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22d528-3ec7-4974-b142-bdde6186a11e service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:03.626553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:03.627180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:03.627450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:03.627761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] PATH_INFO: `/v3/users/ecca297cf7c14fe297d583e2481b158b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:03.629152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecca297cf7c14fe297d583e2481b158b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:03.631531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:03.637815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:03.683629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecca297cf7c14fe297d583e2481b158b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.698741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecca297cf7c14fe297d583e2481b158b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.707187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecca297cf7c14fe297d583e2481b158b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.707915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecca297cf7c14fe297d583e2481b158b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.708518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d99264e-86a6-4e51-bb6b-b6d9d3401a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecca297cf7c14fe297d583e2481b158b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:03.725800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1048/2105] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:03 2022] DELETE /identity/v3/users/ecca297cf7c14fe297d583e2481b158b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:04.028964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.030997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:04.047847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f7c3-38d0-47d7-932f-5f7ae24bb6b4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.127188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.127867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.128512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.128641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] PATH_INFO: `/v3/projects/9e9dffc005af4788baff4c349fec4b51` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.129912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9dffc005af4788baff4c349fec4b51)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.131836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:04.189503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9dffc005af4788baff4c349fec4b51', 'request_id': 'req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:04.199253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9dffc005af4788baff4c349fec4b51', 'request_id': 'req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:04.208724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9dffc005af4788baff4c349fec4b51', 'request_id': 'req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:04.210442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:04.225465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] The token cache is being invalidate because project 9e9dffc005af4788baff4c349fec4b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:04.225786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:04.226566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-69fd8b1e-6d3f-49de-bbc7-b5d28671b60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:04.228379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1058/2106] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:04 2022] DELETE /identity/v3/projects/9e9dffc005af4788baff4c349fec4b51 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:04.234376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febfaa-967e-46b8-95a9-160fc2797ea7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.234896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febfaa-967e-46b8-95a9-160fc2797ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.235010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80febfaa-967e-46b8-95a9-160fc2797ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.257663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-80febfaa-967e-46b8-95a9-160fc2797ea7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:04.259286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-80febfaa-967e-46b8-95a9-160fc2797ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:04.340469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1049/2107] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:04.348303 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fab8-c3d6-480c-b1f9-b96e2d5e8ce1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.348591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fab8-c3d6-480c-b1f9-b96e2d5e8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.348900 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fab8-c3d6-480c-b1f9-b96e2d5e8ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.372476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e639fab8-c3d6-480c-b1f9-b96e2d5e8ce1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:04.373910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e639fab8-c3d6-480c-b1f9-b96e2d5e8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:04.383012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1059/2108] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:04.387726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80febfaa-967e-46b8-95a9-160fc2797ea7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.399426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80febfaa-967e-46b8-95a9-160fc2797ea7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.404367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.405393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.405534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.405770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.406467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:04.406772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.408521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:04.424649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1050/2109] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:04:04.429647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fab8-c3d6-480c-b1f9-b96e2d5e8ce1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.441971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fab8-c3d6-480c-b1f9-b96e2d5e8ce1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.447071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.447681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.448104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.448388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.449085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.451244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:04.485571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1060/2110] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:04 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:04.489892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.505258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d99bf-8739-4f69-9860-6895464dff6d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.575174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.575903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.576319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.576639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.577451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.579413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:04.603987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1051/2111] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:04 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:04.608501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.619007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2543c-8f88-42b5-acaf-1bb790daf190 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.624116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.624774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.625125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.625398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.626074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.627675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:04.637668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1061/2112] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:04.641791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.647114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:04.654261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790a461-d0c0-49dc-a53d-a81918c1728f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.661153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a4151-0a14-4ef1-8f4a-7089c93d51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.661787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a4151-0a14-4ef1-8f4a-7089c93d51c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.662053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a4151-0a14-4ef1-8f4a-7089c93d51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.662330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a4151-0a14-4ef1-8f4a-7089c93d51c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.663212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a4151-0a14-4ef1-8f4a-7089c93d51c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.665083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a4151-0a14-4ef1-8f4a-7089c93d51c6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:04.679374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1052/2113] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:04.685826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.696654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a113-c0d6-4a10-b5b4-406694f47e14 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.702546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.703205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.703511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.703780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] PATH_INFO: `/v3/projects/4d6e59eaec844c678d9dd0178b9515dc/users/9254a5448f4043a6816092519f3d08ce/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.720352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6e59eaec844c678d9dd0178b9515dc, user_id=9254a5448f4043a6816092519f3d08ce, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.723227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:04.741292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1062/2114] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:04 2022] PUT /identity/v3/projects/4d6e59eaec844c678d9dd0178b9515dc/users/9254a5448f4043a6816092519f3d08ce/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:04.752488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e634607-c885-4184-99f0-b76663b98444 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.752882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e634607-c885-4184-99f0-b76663b98444 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.753156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e634607-c885-4184-99f0-b76663b98444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.782747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9e634607-c885-4184-99f0-b76663b98444 None None] MFA Rules not processed for user `9254a5448f4043a6816092519f3d08ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:04.784078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9e634607-c885-4184-99f0-b76663b98444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:04.860770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1053/2115] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:04.878281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:04.880698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:04.967236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27e361-3007-4af1-b498-8758dab4d89c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:04.974369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e1948-85f8-4162-869e-7c9441a1d3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:04.975258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1948-85f8-4162-869e-7c9441a1d3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:04.975715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1948-85f8-4162-869e-7c9441a1d3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:04.975985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1948-85f8-4162-869e-7c9441a1d3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:04.990062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e1948-85f8-4162-869e-7c9441a1d3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:04.992005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e1948-85f8-4162-869e-7c9441a1d3f2 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:05.002278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1063/2116] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:05.024363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e634607-c885-4184-99f0-b76663b98444 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:05.106443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e634607-c885-4184-99f0-b76663b98444 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:05.112373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:05.113644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:05.113941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:05.114217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] PATH_INFO: `/v3/users/9254a5448f4043a6816092519f3d08ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:05.115421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9254a5448f4043a6816092519f3d08ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:05.117911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:05.172281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9254a5448f4043a6816092519f3d08ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:05.186187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9254a5448f4043a6816092519f3d08ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:05.193715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9254a5448f4043a6816092519f3d08ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:05.194531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9254a5448f4043a6816092519f3d08ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:05.195176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9254a5448f4043a6816092519f3d08ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:05.205758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:05.211097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1054/2117] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:05 2022] DELETE /identity/v3/users/9254a5448f4043a6816092519f3d08ce => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:05.216150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:05.216554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:05.216917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:05.239288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:05.240674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:05.301880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1064/2118] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:04:05.315189 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:05.318182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:05.426223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e9d2b-aa3e-40d1-9ff5-b9eb15a1ea09 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:05.430390 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b379bdc-bf6a-4c41-a7f1-6af0ae655079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:05.431134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b379bdc-bf6a-4c41-a7f1-6af0ae655079 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:05.431478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b379bdc-bf6a-4c41-a7f1-6af0ae655079 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:05.431814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b379bdc-bf6a-4c41-a7f1-6af0ae655079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:05.446085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b379bdc-bf6a-4c41-a7f1-6af0ae655079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:05.447683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b379bdc-bf6a-4c41-a7f1-6af0ae655079 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:05.475200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1055/2119] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:06.003801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.005696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:06.018569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251b9c-1e19-4109-ac7e-41677b36503d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.025345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.026008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.026314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.026593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] PATH_INFO: `/v3/projects/4d6e59eaec844c678d9dd0178b9515dc` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.027757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6e59eaec844c678d9dd0178b9515dc)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.029981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.066832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:06.083444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6e59eaec844c678d9dd0178b9515dc', 'request_id': 'req-965f687d-a86c-417c-aae3-d047f651a8b5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:06.089093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6e59eaec844c678d9dd0178b9515dc', 'request_id': 'req-965f687d-a86c-417c-aae3-d047f651a8b5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:06.097635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6e59eaec844c678d9dd0178b9515dc', 'request_id': 'req-965f687d-a86c-417c-aae3-d047f651a8b5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:06.109858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] The token cache is being invalidate because project 4d6e59eaec844c678d9dd0178b9515dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:06.110152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:06.110801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-965f687d-a86c-417c-aae3-d047f651a8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:06.112333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1065/2120] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:06 2022] DELETE /identity/v3/projects/4d6e59eaec844c678d9dd0178b9515dc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:06.117467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612db52-baa3-44d2-9c12-eeea03aaac8c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.117757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612db52-baa3-44d2-9c12-eeea03aaac8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.118029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612db52-baa3-44d2-9c12-eeea03aaac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.140059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7612db52-baa3-44d2-9c12-eeea03aaac8c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:06.141316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7612db52-baa3-44d2-9c12-eeea03aaac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:06.205865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1056/2121] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:06.215445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff4e98-7c0f-4cd0-94e1-42fce28b003a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.215732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff4e98-7c0f-4cd0-94e1-42fce28b003a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.216001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff4e98-7c0f-4cd0-94e1-42fce28b003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.237400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-28ff4e98-7c0f-4cd0-94e1-42fce28b003a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:06.238617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-28ff4e98-7c0f-4cd0-94e1-42fce28b003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:06.247638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1066/2122] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:06.252037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612db52-baa3-44d2-9c12-eeea03aaac8c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.261929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612db52-baa3-44d2-9c12-eeea03aaac8c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.266577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.267210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.267484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.267746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.268412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:06.268704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.270361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.282519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1057/2123] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:04:06.287157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff4e98-7c0f-4cd0-94e1-42fce28b003a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.298249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff4e98-7c0f-4cd0-94e1-42fce28b003a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.303982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.304608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.304934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.305179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.305945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.307850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.339090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1067/2124] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:06 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:06.343899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.353970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69352b2e-20b2-4d64-b1fe-8a0ea02a411f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.436603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.437247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.437522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.437788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.439232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.440361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.465056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1058/2125] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:06 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:06.469775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.480992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3fba-d38f-40cc-afbd-efe6a1a4201f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.486729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.487657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.487657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.487949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.488557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.490215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.508445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1068/2126] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:06.513628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.530573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625af857-ecb4-485f-8f44-797df708c330 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.537254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f652c-8c3f-4dcd-84b2-45986ce0fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.537874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f652c-8c3f-4dcd-84b2-45986ce0fec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.538284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f652c-8c3f-4dcd-84b2-45986ce0fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.538969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f652c-8c3f-4dcd-84b2-45986ce0fec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.540114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f652c-8c3f-4dcd-84b2-45986ce0fec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.541813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f652c-8c3f-4dcd-84b2-45986ce0fec2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.565354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1059/2127] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:06.569419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.584229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec68ef-6f8f-4991-9379-a7ff8d3540fe admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.592128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.592977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.593438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.593885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] PATH_INFO: `/v3/projects/e93acfceeadc49d8a0c58c89ff155624/users/532ea2661c5c4256af05e8ddc8a3b0b3/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.613519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93acfceeadc49d8a0c58c89ff155624, user_id=532ea2661c5c4256af05e8ddc8a3b0b3, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.616277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.645075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1069/2128] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:06 2022] PUT /identity/v3/projects/e93acfceeadc49d8a0c58c89ff155624/users/532ea2661c5c4256af05e8ddc8a3b0b3/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:06.647132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee2c1-2e68-4ebf-8720-6875ff9ee013 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.647768 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee2c1-2e68-4ebf-8720-6875ff9ee013 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.648248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee2c1-2e68-4ebf-8720-6875ff9ee013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.670800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:06.681268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-03cee2c1-2e68-4ebf-8720-6875ff9ee013 None None] MFA Rules not processed for user `532ea2661c5c4256af05e8ddc8a3b0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:06.682819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-03cee2c1-2e68-4ebf-8720-6875ff9ee013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:06.763404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1060/2129] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:06.768091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.841087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1fe51-bd43-4393-ab4f-ba7e3b8f2409 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.846238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.846899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.847178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.847449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.848152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.850078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.879717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1070/2130] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:06 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:06.883858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee2c1-2e68-4ebf-8720-6875ff9ee013 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:06.895865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee2c1-2e68-4ebf-8720-6875ff9ee013 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:06.955574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:06.956221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:06.956504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:06.956777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:06.957462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:06.959564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:06.988495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1061/2131] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:06 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:06.992852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:07.008833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ceea-cf66-49c1-822c-671f738e406b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:07.014318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:07.015054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:07.015398 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:07.015734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:07.016478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:07.018183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:07.030261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1071/2132] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:04:07.034671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:07.046785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f9a7-e54a-4945-b88b-e45b449b622b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:07.052438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:07.053388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:07.053388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:07.053669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] PATH_INFO: `/v3/projects/38cc3a647d824963bab3579d9385478d/users/b2b41aaf9b924cd1afb007e62f045c6b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:07.072203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cc3a647d824963bab3579d9385478d, user_id=b2b41aaf9b924cd1afb007e62f045c6b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:07.075689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:07.094959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1062/2133] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:07 2022] PUT /identity/v3/projects/38cc3a647d824963bab3579d9385478d/users/b2b41aaf9b924cd1afb007e62f045c6b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:04:07.099567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:07.112922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f5ea6-287e-4d91-a6b3-093761da780a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:07.161795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:07.202324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114753e4-7433-44e9-9331-e4f550c957c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:07.205329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114753e4-7433-44e9-9331-e4f550c957c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:07.205652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114753e4-7433-44e9-9331-e4f550c957c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:07.205877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114753e4-7433-44e9-9331-e4f550c957c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:07.206518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114753e4-7433-44e9-9331-e4f550c957c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:07.208227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114753e4-7433-44e9-9331-e4f550c957c5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:07.219404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1072/2134] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:07.223872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:07.234753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222119af-1b4a-43a4-a16d-dca4096058cb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:07.239877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:07.240590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:07.240896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:07.241177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] PATH_INFO: `/v3/projects/38cc3a647d824963bab3579d9385478d/users/b2b41aaf9b924cd1afb007e62f045c6b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:07.243525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cc3a647d824963bab3579d9385478d, user_id=b2b41aaf9b924cd1afb007e62f045c6b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:07.246227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:07.256863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1063/2135] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:07 2022] PUT /identity/v3/projects/38cc3a647d824963bab3579d9385478d/users/b2b41aaf9b924cd1afb007e62f045c6b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:07.267747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e138ff-edcf-4d14-a786-e68cbb2b8109 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:07.268023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e138ff-edcf-4d14-a786-e68cbb2b8109 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:07.268260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e138ff-edcf-4d14-a786-e68cbb2b8109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:07.299547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-12e138ff-edcf-4d14-a786-e68cbb2b8109 None None] MFA Rules not processed for user `b2b41aaf9b924cd1afb007e62f045c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:07.300843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-12e138ff-edcf-4d14-a786-e68cbb2b8109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:07.374550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1073/2136] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:07.386899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:07.388749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:07.456190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14430224-43c6-4e39-9615-b6d4ddad87c4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:07.460633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab08a25-ce3a-4b65-a127-029b0531eb6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:07.461291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08a25-ce3a-4b65-a127-029b0531eb6d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:07.461568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08a25-ce3a-4b65-a127-029b0531eb6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:07.461833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08a25-ce3a-4b65-a127-029b0531eb6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:07.466399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:07.535110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab08a25-ce3a-4b65-a127-029b0531eb6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:07.536472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab08a25-ce3a-4b65-a127-029b0531eb6d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:07.546048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1064/2137] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:10.149975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e138ff-edcf-4d14-a786-e68cbb2b8109 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:10.215806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e138ff-edcf-4d14-a786-e68cbb2b8109 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:10.220927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:10.221579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:10.221857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:10.222129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] PATH_INFO: `/v3/users/532ea2661c5c4256af05e8ddc8a3b0b3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:10.223291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532ea2661c5c4256af05e8ddc8a3b0b3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:10.225266 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:10.284784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532ea2661c5c4256af05e8ddc8a3b0b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:10.287159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:10.294457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532ea2661c5c4256af05e8ddc8a3b0b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:10.304333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532ea2661c5c4256af05e8ddc8a3b0b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:10.304996 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532ea2661c5c4256af05e8ddc8a3b0b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:10.319834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532ea2661c5c4256af05e8ddc8a3b0b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:10.326116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1074/2138] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:10 2022] DELETE /identity/v3/users/532ea2661c5c4256af05e8ddc8a3b0b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:10.331406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:10.331913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:10.332007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:10.352496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:10.353792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:10.418486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1065/2139] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:10.428954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:10.430950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:10.499773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3fa6c-eff9-4c9c-b784-3f293b4909c4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:10.503395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:10.504102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:10.504382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:10.504674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:10.515156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:10.516598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:10.527158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1075/2140] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:10.933504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:10.935275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:10.960060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19003a-36f0-4236-acd0-7dae39f86939 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:10.966429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:10.968194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:10.968768 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:10.969398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] PATH_INFO: `/v3/projects/e93acfceeadc49d8a0c58c89ff155624` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:10.971316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93acfceeadc49d8a0c58c89ff155624)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:10.974364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:11.036534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93acfceeadc49d8a0c58c89ff155624', 'request_id': 'req-b8b68881-edb6-4490-93c5-c2cb280dc524'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.043343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93acfceeadc49d8a0c58c89ff155624', 'request_id': 'req-b8b68881-edb6-4490-93c5-c2cb280dc524'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.050790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93acfceeadc49d8a0c58c89ff155624', 'request_id': 'req-b8b68881-edb6-4490-93c5-c2cb280dc524'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.066096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] The token cache is being invalidate because project e93acfceeadc49d8a0c58c89ff155624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:11.066384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.067095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.069402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1066/2141] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:10 2022] DELETE /identity/v3/projects/e93acfceeadc49d8a0c58c89ff155624 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:11.073830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:11.084391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6aac3-4c34-47b2-8469-be5a5c75c716 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:11.146613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:11.147248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:11.147520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:11.147784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] PATH_INFO: `/v3/users/b2b41aaf9b924cd1afb007e62f045c6b` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:11.148913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b41aaf9b924cd1afb007e62f045c6b)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:11.150875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:11.200688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b41aaf9b924cd1afb007e62f045c6b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.208136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b41aaf9b924cd1afb007e62f045c6b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.217055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b41aaf9b924cd1afb007e62f045c6b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.217738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b41aaf9b924cd1afb007e62f045c6b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.225491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:11.231363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa936d3b-f448-4262-b1a8-4d78c82cfe07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b41aaf9b924cd1afb007e62f045c6b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.239224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1076/2142] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:11 2022] DELETE /identity/v3/users/b2b41aaf9b924cd1afb007e62f045c6b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:11.551545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:11.553064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:11.566428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68881-edb6-4490-93c5-c2cb280dc524 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:11.594843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:11.635541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:11.636255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:11.636521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:11.636702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] PATH_INFO: `/v3/projects/38cc3a647d824963bab3579d9385478d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:11.637897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cc3a647d824963bab3579d9385478d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:11.639863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:11.699883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cc3a647d824963bab3579d9385478d', 'request_id': 'req-5a2dab46-b331-493f-8fdc-ff656ae84c3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.707393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cc3a647d824963bab3579d9385478d', 'request_id': 'req-5a2dab46-b331-493f-8fdc-ff656ae84c3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.714154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cc3a647d824963bab3579d9385478d', 'request_id': 'req-5a2dab46-b331-493f-8fdc-ff656ae84c3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.729524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] The token cache is being invalidate because project 38cc3a647d824963bab3579d9385478d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:11.729807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.730442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a2dab46-b331-493f-8fdc-ff656ae84c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:11.731964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1067/2143] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:11 2022] DELETE /identity/v3/projects/38cc3a647d824963bab3579d9385478d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:11.737721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac6992-9318-4f53-bb2e-337b678f3b24 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:11.738071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac6992-9318-4f53-bb2e-337b678f3b24 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:11.738353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac6992-9318-4f53-bb2e-337b678f3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:11.762457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b0ac6992-9318-4f53-bb2e-337b678f3b24 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:11.764371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b0ac6992-9318-4f53-bb2e-337b678f3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:11.833377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1077/2144] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:11.843601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61087b-6b24-4da3-83b0-340719c4561e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:11.844195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61087b-6b24-4da3-83b0-340719c4561e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:11.844467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61087b-6b24-4da3-83b0-340719c4561e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:11.867269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fb61087b-6b24-4da3-83b0-340719c4561e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:11.868502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb61087b-6b24-4da3-83b0-340719c4561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:11.893822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1068/2145] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:11.895591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac6992-9318-4f53-bb2e-337b678f3b24 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:11.910363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac6992-9318-4f53-bb2e-337b678f3b24 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:11.914441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:11.915767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:11.916141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:11.916510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:11.917548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:11.918050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:11.919987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:11.943229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1078/2146] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:04:11.947408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61087b-6b24-4da3-83b0-340719c4561e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:11.958153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61087b-6b24-4da3-83b0-340719c4561e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:11.963317 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:11.963958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:11.964234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:11.964503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:11.965199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:11.967216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.016261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1069/2147] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:11 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:12.021500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.032879 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448714-340c-4362-a46c-69b0eb22c7bc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.119730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.120611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.121061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.121477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.122385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.124569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.167004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1079/2148] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:12 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:12.167736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.179479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f607af8-42c0-41fc-9bfe-1e0f2b2a29ac admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.185292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.185484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.185716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.185983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.186631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.188333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.200229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1070/2149] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:04:12.204614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.216613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40dcea-d5b2-4c59-bbef-caae53058926 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.221642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae2233-fd92-42fb-88e0-aa1c8a26d3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.222550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae2233-fd92-42fb-88e0-aa1c8a26d3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.222833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae2233-fd92-42fb-88e0-aa1c8a26d3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.223108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae2233-fd92-42fb-88e0-aa1c8a26d3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.223776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae2233-fd92-42fb-88e0-aa1c8a26d3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.225418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae2233-fd92-42fb-88e0-aa1c8a26d3d6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.253618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1080/2150] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:12.255160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.269627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156b91e-e711-4e35-b959-cd3e057642ac admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.278831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.281962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.282323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.282587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] PATH_INFO: `/v3/projects/7ea0b429a34043128b3b42122fbdb1ff/users/b6f7422013024024a18526b31f9e7dd1/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.327424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea0b429a34043128b3b42122fbdb1ff, user_id=b6f7422013024024a18526b31f9e7dd1, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.338259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.354947 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1071/2151] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:12 2022] PUT /identity/v3/projects/7ea0b429a34043128b3b42122fbdb1ff/users/b6f7422013024024a18526b31f9e7dd1/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:12.366319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5ca4-7d14-4a42-bd2b-d99363c4104c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.366652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5ca4-7d14-4a42-bd2b-d99363c4104c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.367008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5ca4-7d14-4a42-bd2b-d99363c4104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.395312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-745f5ca4-7d14-4a42-bd2b-d99363c4104c None None] MFA Rules not processed for user `b6f7422013024024a18526b31f9e7dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:12.396598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-745f5ca4-7d14-4a42-bd2b-d99363c4104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:12.442975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:12.465723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1081/2152] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:12.470849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.537420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:12.543902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84ae16-9fe2-44f0-963a-94fd82b0a8a5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.551013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.551909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.552658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.552658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.553245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.555750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.592684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1072/2153] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:12 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:12.597511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f5ca4-7d14-4a42-bd2b-d99363c4104c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.609338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f5ca4-7d14-4a42-bd2b-d99363c4104c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.671103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.671914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.672192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.672459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.673124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.675040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.703524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1082/2154] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:12 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:12.704868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.715604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff954ad8-dae8-4b98-a706-57c85ff0f784 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.720587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.721326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.721541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.721810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.722500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.724962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.739993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1073/2155] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:12.745114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.767150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136769-ef88-4ca5-8b4d-b0c73e44de34 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.775142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8af09b-ccbb-4117-926d-d9435d0f5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.775906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af09b-ccbb-4117-926d-d9435d0f5bac admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.776317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af09b-ccbb-4117-926d-d9435d0f5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.776683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af09b-ccbb-4117-926d-d9435d0f5bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.778457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8af09b-ccbb-4117-926d-d9435d0f5bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.780842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8af09b-ccbb-4117-926d-d9435d0f5bac admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.792599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1083/2156] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:12.797297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:12.807844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887857-0975-4db9-93eb-928e17cb0090 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:12.812540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:12.813394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.813691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.813965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] PATH_INFO: `/v3/projects/30a81b64bd1341509dcbffadf3e23eeb/users/9f636d3879a14acb9b08c0f0fe277406/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.830024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a81b64bd1341509dcbffadf3e23eeb, user_id=9f636d3879a14acb9b08c0f0fe277406, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:12.832666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:12.847925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1074/2157] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:12 2022] PUT /identity/v3/projects/30a81b64bd1341509dcbffadf3e23eeb/users/9f636d3879a14acb9b08c0f0fe277406/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:12.859751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5c2a4-f8f0-47da-92c2-44aa69002f22 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:12.860037 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5c2a4-f8f0-47da-92c2-44aa69002f22 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:12.860315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5c2a4-f8f0-47da-92c2-44aa69002f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:12.888477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b2a5c2a4-f8f0-47da-92c2-44aa69002f22 None None] MFA Rules not processed for user `9f636d3879a14acb9b08c0f0fe277406`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:12.889745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b2a5c2a4-f8f0-47da-92c2-44aa69002f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:12.955646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1084/2158] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:12.960343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.024958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68913f-ae8d-4f5a-b64b-64f679c3288d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.029922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.030536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.030818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.031093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.033272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.035195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.066767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1075/2159] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:12 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:13.071108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5c2a4-f8f0-47da-92c2-44aa69002f22 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.082673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5c2a4-f8f0-47da-92c2-44aa69002f22 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.134873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:13.147818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.148461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.148744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.149048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.149700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.151852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.182219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1085/2160] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:13 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:04:13.184342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.196662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58cc4-ec2d-4052-9f12-5fecde927566 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.204617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.205299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.205580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.205850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.206516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.208383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.222915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1076/2161] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:13.227389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.239547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a664-7799-4bd3-807b-138f48f892c4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.244604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.245353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.245632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.245907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] PATH_INFO: `/v3/projects/9d4c109a1d4a45e0ae082d12239a93b0/users/bdb55be3483c465a8cbcbff5d04be372/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.265358 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4c109a1d4a45e0ae082d12239a93b0, user_id=bdb55be3483c465a8cbcbff5d04be372, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.268921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.286995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1086/2162] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:13 2022] PUT /identity/v3/projects/9d4c109a1d4a45e0ae082d12239a93b0/users/bdb55be3483c465a8cbcbff5d04be372/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:04:13.291106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.303939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26999898-9558-462b-99cb-a7b06e474afd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.407029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab33c1-268d-4188-8eaf-0f231f5f3d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.407630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab33c1-268d-4188-8eaf-0f231f5f3d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.407896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab33c1-268d-4188-8eaf-0f231f5f3d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.408304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab33c1-268d-4188-8eaf-0f231f5f3d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.409130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab33c1-268d-4188-8eaf-0f231f5f3d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.410737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab33c1-268d-4188-8eaf-0f231f5f3d02 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.428054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1077/2163] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:13.429342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.459426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca6c11-e190-4c43-9fa3-4620983ecf61 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.470700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.471391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.471663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.471936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] PATH_INFO: `/v3/projects/9d4c109a1d4a45e0ae082d12239a93b0/users/bdb55be3483c465a8cbcbff5d04be372/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.474261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4c109a1d4a45e0ae082d12239a93b0, user_id=bdb55be3483c465a8cbcbff5d04be372, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.477038 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.504847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1087/2164] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:13 2022] PUT /identity/v3/projects/9d4c109a1d4a45e0ae082d12239a93b0/users/bdb55be3483c465a8cbcbff5d04be372/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:13.510446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.511299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.511299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.581158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] MFA Rules not processed for user `bdb55be3483c465a8cbcbff5d04be372`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:13.582567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:13.596166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:13.597885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.602141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:13.719120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039a5c-bbb4-408c-b985-251f5f5aebc5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.725209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.726024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.726309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.726575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] PATH_INFO: `/v3/users/6c3f1b1f89434d4b8bc4750b94205a25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.728176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3f1b1f89434d4b8bc4750b94205a25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.730649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.743838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1078/2165] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:13.771640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.775290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:13.805555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3f1b1f89434d4b8bc4750b94205a25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:13.819129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3f1b1f89434d4b8bc4750b94205a25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:13.829262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3f1b1f89434d4b8bc4750b94205a25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:13.831491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3f1b1f89434d4b8bc4750b94205a25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:13.845059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44ea8cda-9570-4d7d-9def-125210752252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3f1b1f89434d4b8bc4750b94205a25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:13.847934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3742e-1726-4fa9-b1fc-821f8f7b6f10 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:13.851578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1088/2166] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:13 2022] DELETE /identity/v3/users/6c3f1b1f89434d4b8bc4750b94205a25 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:13.852259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:13.853227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.853227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.853521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.855265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:13.856508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:13.856508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:13.856771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:13.878278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:13.879528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:13.900455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:13.938264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:13.939983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:13.952715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1079/2167] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:13.963650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1089/2168] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:04:13.975006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:13.977437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:14.047742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21347-7ed6-487b-b243-3346efcf53f3 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:14.056882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:14.104854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:14.105601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:14.105933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:14.106207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:14.117414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:14.119162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:14.130204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1080/2169] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:14.456423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:14.458046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:14.471183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf87c2-3a7f-4b5d-bfce-632ad7239321 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:14.476618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:14.477300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:14.477581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:14.477843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] PATH_INFO: `/v3/projects/515154d451974fc9926ee623e4e02a50` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:14.479179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=515154d451974fc9926ee623e4e02a50)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:14.481227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:14.535922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515154d451974fc9926ee623e4e02a50', 'request_id': 'req-9c052d04-6582-4d55-9ec4-efde6e62f367'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:14.542760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515154d451974fc9926ee623e4e02a50', 'request_id': 'req-9c052d04-6582-4d55-9ec4-efde6e62f367'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:14.551574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515154d451974fc9926ee623e4e02a50', 'request_id': 'req-9c052d04-6582-4d55-9ec4-efde6e62f367'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:14.566624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] The token cache is being invalidate because project 515154d451974fc9926ee623e4e02a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:14.566915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:14.567589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:14.569149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1090/2170] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:14 2022] DELETE /identity/v3/projects/515154d451974fc9926ee623e4e02a50 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:15.496267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:15.497922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:15.566504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7af44-0aa8-432b-99a5-13e1098422d1 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:15.621303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:15.621945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:15.622216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:15.622530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:15.624457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:15.686706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:15.688235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:15.698208 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1081/2171] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:16.335494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:16.337126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:16.349779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c052d04-6582-4d55-9ec4-efde6e62f367 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:16.353663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1667026-89e4-4cf1-b1b7-38ac61f9f2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:16.354261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667026-89e4-4cf1-b1b7-38ac61f9f2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:16.354538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667026-89e4-4cf1-b1b7-38ac61f9f2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:16.354800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667026-89e4-4cf1-b1b7-38ac61f9f2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:16.356611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b1667026-89e4-4cf1-b1b7-38ac61f9f2e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:16.426438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1667026-89e4-4cf1-b1b7-38ac61f9f2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:16.427915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1667026-89e4-4cf1-b1b7-38ac61f9f2e3 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:16.438295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1091/2172] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:20.416679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:20.418202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:20.446517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:20.495418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d2e7f-3281-4eb8-b856-0f246b84fd43 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:20.500538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:20.501218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:20.501499 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:20.501763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] PATH_INFO: `/v3/users/b6f7422013024024a18526b31f9e7dd1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:20.503058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f7422013024024a18526b31f9e7dd1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:20.505075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:20.565849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f7422013024024a18526b31f9e7dd1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:20.578462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f7422013024024a18526b31f9e7dd1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:20.586179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f7422013024024a18526b31f9e7dd1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:20.586924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f7422013024024a18526b31f9e7dd1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:20.587541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f7422013024024a18526b31f9e7dd1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:20.603442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1082/2173] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:20 2022] DELETE /identity/v3/users/b6f7422013024024a18526b31f9e7dd1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:20.610073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:20.610543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:20.610654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:20.635159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:20.636515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:20.679162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:20.710409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1092/2174] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:20.720518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:20.722078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:20.784404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c3ad-feb4-4977-b3b0-fc19cbbc80c9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:20.788515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:20.789193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:20.789465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:20.789732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:20.817271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:20.819355 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:20.831294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1083/2175] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:21.209788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:21.211416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:21.224270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227e04-0a13-4f76-a0d2-ad0325e022d2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:21.229830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:21.230513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:21.230842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:21.231113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] PATH_INFO: `/v3/projects/7ea0b429a34043128b3b42122fbdb1ff` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:21.232254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea0b429a34043128b3b42122fbdb1ff)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:21.234680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:21.290956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea0b429a34043128b3b42122fbdb1ff', 'request_id': 'req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.297285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea0b429a34043128b3b42122fbdb1ff', 'request_id': 'req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.306195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea0b429a34043128b3b42122fbdb1ff', 'request_id': 'req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.318640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] The token cache is being invalidate because project 7ea0b429a34043128b3b42122fbdb1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:21.318925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.319569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.321267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1093/2176] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:21 2022] DELETE /identity/v3/projects/7ea0b429a34043128b3b42122fbdb1ff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:21.326188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:21.340036 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb55c37-8e00-449b-b337-c62eb7a4d519 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:21.395706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:21.413170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:21.413816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:21.414101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:21.414360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] PATH_INFO: `/v3/users/9f636d3879a14acb9b08c0f0fe277406` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:21.416128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f636d3879a14acb9b08c0f0fe277406)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:21.417935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:21.475904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f636d3879a14acb9b08c0f0fe277406'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.489051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f636d3879a14acb9b08c0f0fe277406'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.496222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f636d3879a14acb9b08c0f0fe277406'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.496985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f636d3879a14acb9b08c0f0fe277406'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.497608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f636d3879a14acb9b08c0f0fe277406'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:21.513410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1084/2177] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:21 2022] DELETE /identity/v3/users/9f636d3879a14acb9b08c0f0fe277406 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:04:21.864426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:21.866680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:21.882500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea942-e26f-4d57-9c37-1e24c9f39d50 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:21.952554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:21.953227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:21.953499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:21.953766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] PATH_INFO: `/v3/projects/30a81b64bd1341509dcbffadf3e23eeb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:21.954882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a81b64bd1341509dcbffadf3e23eeb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:21.957168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:22.008336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a81b64bd1341509dcbffadf3e23eeb', 'request_id': 'req-e71a9d6c-0e5c-4220-ae86-c6c22e987177'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.021590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a81b64bd1341509dcbffadf3e23eeb', 'request_id': 'req-e71a9d6c-0e5c-4220-ae86-c6c22e987177'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.031064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a81b64bd1341509dcbffadf3e23eeb', 'request_id': 'req-e71a9d6c-0e5c-4220-ae86-c6c22e987177'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.034201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:22.053728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] The token cache is being invalidate because project 30a81b64bd1341509dcbffadf3e23eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:22.054617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.054740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.056357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1094/2178] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:21 2022] DELETE /identity/v3/projects/30a81b64bd1341509dcbffadf3e23eeb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:22.061535 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:22.063258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:22.077349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefe8db-5a1d-4135-a0b0-05a741e37185 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:22.144687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:22.145449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:22.145738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:22.146054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] PATH_INFO: `/v3/users/bdb55be3483c465a8cbcbff5d04be372` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:22.147327 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb55be3483c465a8cbcbff5d04be372)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:22.149383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:22.216508 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb55be3483c465a8cbcbff5d04be372'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.232133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb55be3483c465a8cbcbff5d04be372'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.235398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:22.244515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb55be3483c465a8cbcbff5d04be372'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.245529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb55be3483c465a8cbcbff5d04be372'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.246278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f94c74e-62d4-4f51-929f-4f3fb97675ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb55be3483c465a8cbcbff5d04be372'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.261851 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1085/2179] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:22 2022] DELETE /identity/v3/users/bdb55be3483c465a8cbcbff5d04be372 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:22.582088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:22.583617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:22.597949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9d6c-0e5c-4220-ae86-c6c22e987177 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:22.672328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:22.673120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:22.673470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:22.673809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] PATH_INFO: `/v3/projects/9d4c109a1d4a45e0ae082d12239a93b0` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:22.676312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4c109a1d4a45e0ae082d12239a93b0)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:22.678355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:22.732161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4c109a1d4a45e0ae082d12239a93b0', 'request_id': 'req-52ab570e-3822-4fe3-8ab1-db2ea027a174'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.739700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4c109a1d4a45e0ae082d12239a93b0', 'request_id': 'req-52ab570e-3822-4fe3-8ab1-db2ea027a174'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.749058 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4c109a1d4a45e0ae082d12239a93b0', 'request_id': 'req-52ab570e-3822-4fe3-8ab1-db2ea027a174'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.764608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] The token cache is being invalidate because project 9d4c109a1d4a45e0ae082d12239a93b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:22.765163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.766942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52ab570e-3822-4fe3-8ab1-db2ea027a174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:22.769907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1095/2180] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:22 2022] DELETE /identity/v3/projects/9d4c109a1d4a45e0ae082d12239a93b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:22.774997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddca25-b5cd-4199-8de6-aac6a124ce06 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:22.775497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddca25-b5cd-4199-8de6-aac6a124ce06 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:22.775614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddca25-b5cd-4199-8de6-aac6a124ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:22.795825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-75ddca25-b5cd-4199-8de6-aac6a124ce06 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:22.797075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-75ddca25-b5cd-4199-8de6-aac6a124ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:22.866102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1086/2181] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:22.875106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6327c-332c-4244-bba5-4366f6cb3237 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:22.875106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6327c-332c-4244-bba5-4366f6cb3237 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:22.875106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6327c-332c-4244-bba5-4366f6cb3237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:22.897101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f0a6327c-332c-4244-bba5-4366f6cb3237 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:22.898544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f0a6327c-332c-4244-bba5-4366f6cb3237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:22.907165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1096/2182] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:22.912002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddca25-b5cd-4199-8de6-aac6a124ce06 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:22.923125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddca25-b5cd-4199-8de6-aac6a124ce06 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:22.928708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:22.929336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:22.929608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:22.929907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:22.930670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:22.930859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:22.932507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:22.946980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1087/2183] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:04:22.951716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6327c-332c-4244-bba5-4366f6cb3237 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:22.962204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6327c-332c-4244-bba5-4366f6cb3237 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:22.967281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:22.967999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:22.968314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:22.968647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:22.969448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:22.971722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:23.008888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1097/2184] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:22 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:23.012247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:23.023763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6031f-7607-4494-9ed3-972d0d864216 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:23.094960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:23.095261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:23.095541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:23.096002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:23.096918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:23.098873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:23.122033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1088/2185] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:23 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:23.126752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:23.141514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7be42a-8dab-4ba2-b8ac-a80ddb3dd8d5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:23.146699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:23.147325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:23.147600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:23.147864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:23.148510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:23.150278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:23.163315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1098/2186] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:23.167436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:23.181577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c62780-61b8-4c19-9dd9-8f9cc5e72179 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:23.186540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77eda6-e287-4878-9498-2606b9921878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:23.187306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77eda6-e287-4878-9498-2606b9921878 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:23.187605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77eda6-e287-4878-9498-2606b9921878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:23.187871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77eda6-e287-4878-9498-2606b9921878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:23.188620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77eda6-e287-4878-9498-2606b9921878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:23.190227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77eda6-e287-4878-9498-2606b9921878 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:23.201349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1089/2187] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:23.205675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:23.217689 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294bb6c-fa1b-498e-ae46-132a753bd3e2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:23.236041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:23.236041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:23.236041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:23.236410 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] PATH_INFO: `/v3/projects/a152fd431ae342a69fd405c4162501ba/users/7a04a30694634afdbf85f923a439c7b4/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:23.255509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a152fd431ae342a69fd405c4162501ba, user_id=7a04a30694634afdbf85f923a439c7b4, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:23.258309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:23.276299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1099/2188] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:23 2022] PUT /identity/v3/projects/a152fd431ae342a69fd405c4162501ba/users/7a04a30694634afdbf85f923a439c7b4/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:23.287911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a74a4-9a18-4f71-a3a0-76dc367eba7e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:23.288195 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a74a4-9a18-4f71-a3a0-76dc367eba7e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:23.288639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a74a4-9a18-4f71-a3a0-76dc367eba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:23.330523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-162a74a4-9a18-4f71-a3a0-76dc367eba7e None None] MFA Rules not processed for user `7a04a30694634afdbf85f923a439c7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:23.332066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-162a74a4-9a18-4f71-a3a0-76dc367eba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:23.384079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:23.419200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1090/2189] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:23.430762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:23.432916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:23.462953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:23.498416 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff4599-2732-4468-aa28-afaa56efc90e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:23.504853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:23.505500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:23.505777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:23.506053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:23.520409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:23.521895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:23.532082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1100/2190] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:27.515692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c006-21e8-481f-af09-5d00c195c78f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:27.516186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c006-21e8-481f-af09-5d00c195c78f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:27.516274 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c006-21e8-481f-af09-5d00c195c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:27.537972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bd93c006-21e8-481f-af09-5d00c195c78f None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:27.539699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd93c006-21e8-481f-af09-5d00c195c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:27.602579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1091/2191] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:04:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:27.652641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:27.654342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:27.743103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476e9b-b3f2-464f-9f59-5a6575fa8726 service glance] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:27.749083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f286f67-849a-4876-9005-02910ce8082f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:27.749712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f286f67-849a-4876-9005-02910ce8082f service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:27.749999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f286f67-849a-4876-9005-02910ce8082f service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:27.750268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f286f67-849a-4876-9005-02910ce8082f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:27.760012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f286f67-849a-4876-9005-02910ce8082f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:27.761848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f286f67-849a-4876-9005-02910ce8082f service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:27.770212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1101/2192] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:04:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:04:37.593447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=34 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:37.766989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=48 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:38.174733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafe51-9f24-4a07-85e8-1ce2b5d2ff4e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:38.175010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafe51-9f24-4a07-85e8-1ce2b5d2ff4e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:38.175295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafe51-9f24-4a07-85e8-1ce2b5d2ff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:38.198439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3abafe51-9f24-4a07-85e8-1ce2b5d2ff4e None None] MFA Rules not processed for user `40ed6647aea94ff9b717b79a34faa3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:38.199722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3abafe51-9f24-4a07-85e8-1ce2b5d2ff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:38.276847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1092/2193] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:48.265572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=25 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:50.418020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:50.418553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:50.418553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:50.438610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:50.439844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:50.448420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1102/2194] 10.222.0.89 () {58 vars in 967 bytes} [Tue Aug 30 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:50.465708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abafe51-9f24-4a07-85e8-1ce2b5d2ff4e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:50.477789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abafe51-9f24-4a07-85e8-1ce2b5d2ff4e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:50.483171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:50.483856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:50.484128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:50.484403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:50.493153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:50.494695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:50.502963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1093/2195] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:04:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:04:52.727912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:52.729743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:52.828167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b86e01-faa9-439d-99d0-8c2a91fd1d69 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:52.833635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:52.834390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:52.834651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:52.834924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] PATH_INFO: `/v3/users/59d57d78b9c14b859009f8ff71a00c5c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:52.836131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d57d78b9c14b859009f8ff71a00c5c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:52.838287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:52.892186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d57d78b9c14b859009f8ff71a00c5c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:52.901244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d57d78b9c14b859009f8ff71a00c5c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:52.910187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d57d78b9c14b859009f8ff71a00c5c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:52.910852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d57d78b9c14b859009f8ff71a00c5c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:52.924438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-09592d6c-adf1-41cb-b052-baccd8374649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d57d78b9c14b859009f8ff71a00c5c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:52.930679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1103/2196] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:52 2022] DELETE /identity/v3/users/59d57d78b9c14b859009f8ff71a00c5c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:53.125978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.142712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9962915-35e7-466c-b41c-ba6f3f5ac5e5 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.201513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.202253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.202528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.202794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] PATH_INFO: `/v3/projects/c10979066b4a4ec8bd5be7f6084cbbdf` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.203908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10979066b4a4ec8bd5be7f6084cbbdf)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.205827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:53.255119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10979066b4a4ec8bd5be7f6084cbbdf', 'request_id': 'req-668670b0-4309-4c05-af8f-ece5a889cee5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:53.261836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10979066b4a4ec8bd5be7f6084cbbdf', 'request_id': 'req-668670b0-4309-4c05-af8f-ece5a889cee5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:53.267270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10979066b4a4ec8bd5be7f6084cbbdf', 'request_id': 'req-668670b0-4309-4c05-af8f-ece5a889cee5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:53.280930 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] The token cache is being invalidate because project c10979066b4a4ec8bd5be7f6084cbbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:53.281219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:53.281832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-668670b0-4309-4c05-af8f-ece5a889cee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:53.283311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1094/2197] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:53 2022] DELETE /identity/v3/projects/c10979066b4a4ec8bd5be7f6084cbbdf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:04:53.288512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71cfa-0c53-4452-957d-58392b4af537 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.288840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71cfa-0c53-4452-957d-58392b4af537 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.289373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71cfa-0c53-4452-957d-58392b4af537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.309830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-31e71cfa-0c53-4452-957d-58392b4af537 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:53.311024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-31e71cfa-0c53-4452-957d-58392b4af537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:53.385556 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1104/2198] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:53.394488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537c4f-f14b-4eb5-a894-cae2e6daecec None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.394916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537c4f-f14b-4eb5-a894-cae2e6daecec None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.395196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537c4f-f14b-4eb5-a894-cae2e6daecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.417638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-01537c4f-f14b-4eb5-a894-cae2e6daecec None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:53.418839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-01537c4f-f14b-4eb5-a894-cae2e6daecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:53.428458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1095/2199] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:53.433205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e71cfa-0c53-4452-957d-58392b4af537 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.443572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e71cfa-0c53-4452-957d-58392b4af537 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.448201 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.448792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.449097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.449329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.449960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:53.450253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.451848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:53.461330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:53.465133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1105/2200] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:04:53.469818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537c4f-f14b-4eb5-a894-cae2e6daecec None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.480142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537c4f-f14b-4eb5-a894-cae2e6daecec None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.485879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.486472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.486772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.487039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.487688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.489858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:53.528835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1096/2201] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:53 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:53.534955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.546518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748c150-d6ed-4a1a-9d54-84fb9b12af72 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.611571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.612243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.612514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.612933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.613617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.616427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:53.643821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1106/2202] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:53 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:53.648059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.658504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350b16e-7cac-48dc-a295-a6db27b1b2e7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.663937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.664562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.664832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.665126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.665783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.667358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:53.678265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1097/2203] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:53.682722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.693601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee784bc-fb47-49b6-9011-cb61950d4ee1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.699363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170b88b-f149-454f-a353-437a258f38e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.699969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b88b-f149-454f-a353-437a258f38e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.700243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b88b-f149-454f-a353-437a258f38e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.700512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b88b-f149-454f-a353-437a258f38e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.701211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170b88b-f149-454f-a353-437a258f38e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.702871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170b88b-f149-454f-a353-437a258f38e7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:53.714393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1107/2204] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:53.718682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.728921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0960f6-f506-4289-947d-0211f2a6aed4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.734055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.734687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.734950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.735214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] PATH_INFO: `/v3/projects/0d61317379214132936f3abaa14059e2/users/3bf1cda4befa4db9a2f05a116b62c03f/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.752004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d61317379214132936f3abaa14059e2, user_id=3bf1cda4befa4db9a2f05a116b62c03f, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.754823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:53.769905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1098/2205] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:53 2022] PUT /identity/v3/projects/0d61317379214132936f3abaa14059e2/users/3bf1cda4befa4db9a2f05a116b62c03f/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:53.780594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.781148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.781148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.811168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] MFA Rules not processed for user `3bf1cda4befa4db9a2f05a116b62c03f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:53.812382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:53.881989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1108/2206] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:53.897141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:53.899838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:53.919945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:53.977532 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182a89-bb9b-45da-99e2-5d83566953b7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:53.982259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e1aee-39dd-4334-b081-308734fa8809 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:53.982866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1aee-39dd-4334-b081-308734fa8809 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:53.983163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1aee-39dd-4334-b081-308734fa8809 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:53.983415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1aee-39dd-4334-b081-308734fa8809 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:53.993637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e1aee-39dd-4334-b081-308734fa8809 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:53.995071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e1aee-39dd-4334-b081-308734fa8809 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:54.004373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1099/2207] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:55.594202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:55.595674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:55.666638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558af0d-ba8c-45a7-b6de-16b3ea12ac93 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:55.671215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:55.671860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:55.672134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:55.672405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] PATH_INFO: `/v3/users/bedb6c653e34443c9a4742cae6b74588` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:55.673564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bedb6c653e34443c9a4742cae6b74588)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:55.675466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:55.686188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:55.724221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bedb6c653e34443c9a4742cae6b74588'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:55.730898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bedb6c653e34443c9a4742cae6b74588'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:55.740907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bedb6c653e34443c9a4742cae6b74588'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:55.741582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bedb6c653e34443c9a4742cae6b74588'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:55.754142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bedb6c653e34443c9a4742cae6b74588'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:55.760506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1109/2208] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:04:55 2022] DELETE /identity/v3/users/bedb6c653e34443c9a4742cae6b74588 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:55.765534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:55.766118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:55.766266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:55.790165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:55.791446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:55.853515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1100/2209] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:55.864112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:55.866063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:55.939510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e9fc-3f60-4b54-bbf8-202c89ee5101 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:55.943394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd8db-8c01-48c3-9882-143ed441a654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:55.944005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd8db-8c01-48c3-9882-143ed441a654 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:55.944276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd8db-8c01-48c3-9882-143ed441a654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:55.944536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd8db-8c01-48c3-9882-143ed441a654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:55.954523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccd8db-8c01-48c3-9882-143ed441a654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:55.955944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccd8db-8c01-48c3-9882-143ed441a654 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:55.966054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1110/2210] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:04:56.285897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:56.287525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:56.300461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91125-2c18-45b3-a861-11fb6271ae9b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:56.306026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:56.306709 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.306994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.307271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] PATH_INFO: `/v3/projects/79497132eb19421faa618daad9696aa0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.308436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79497132eb19421faa618daad9696aa0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:56.310476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:56.363118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79497132eb19421faa618daad9696aa0', 'request_id': 'req-e57b1d4c-e360-4751-8dff-50bd42005928'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:56.369503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79497132eb19421faa618daad9696aa0', 'request_id': 'req-e57b1d4c-e360-4751-8dff-50bd42005928'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:56.375866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79497132eb19421faa618daad9696aa0', 'request_id': 'req-e57b1d4c-e360-4751-8dff-50bd42005928'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:56.394467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] The token cache is being invalidate because project 79497132eb19421faa618daad9696aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:04:56.394746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:56.395467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e57b1d4c-e360-4751-8dff-50bd42005928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:04:56.397151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1101/2211] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:04:56 2022] DELETE /identity/v3/projects/79497132eb19421faa618daad9696aa0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:56.403462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff480cd-615b-40ab-9f08-392550008407 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.403899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff480cd-615b-40ab-9f08-392550008407 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.404239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff480cd-615b-40ab-9f08-392550008407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.427637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fff480cd-615b-40ab-9f08-392550008407 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:56.428909 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fff480cd-615b-40ab-9f08-392550008407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:56.493852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1111/2212] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:56.502706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fdb99-f573-4dfe-8db8-8a8679b63f14 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.503000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fdb99-f573-4dfe-8db8-8a8679b63f14 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.503275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fdb99-f573-4dfe-8db8-8a8679b63f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.526282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6f9fdb99-f573-4dfe-8db8-8a8679b63f14 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:56.527522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6f9fdb99-f573-4dfe-8db8-8a8679b63f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:56.537188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1102/2213] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:56.541621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff480cd-615b-40ab-9f08-392550008407 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:56.551549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff480cd-615b-40ab-9f08-392550008407 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:56.560605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:56.561694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.562064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.562327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.562994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:04:56.563354 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:56.564964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:56.577955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1112/2214] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:04:56.582513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fdb99-f573-4dfe-8db8-8a8679b63f14 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:56.592637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fdb99-f573-4dfe-8db8-8a8679b63f14 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:56.597796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:56.598409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.598796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.599240 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.599995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:56.602234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:56.639782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1103/2215] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:04:56 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:56.644563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:56.656827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a07e7-4e95-4e58-95a8-9927879fc2a4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:56.672994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:56.721681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:56.722309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.722581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.722844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.723473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:56.725505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:56.751839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1113/2216] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:04:56 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:04:56.755739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:56.767971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3acd2f-6c53-4146-98b8-30c7176599d4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:56.773123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:56.773749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.774019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.774286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.774948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:56.776605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:56.782940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:56.791904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1104/2217] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:04:56.793269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:56.811280 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf165b-c344-438f-a405-aae88652435e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:56.821964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d936e-40c3-4102-b0f7-732436e3982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:56.822601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d936e-40c3-4102-b0f7-732436e3982a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.823067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d936e-40c3-4102-b0f7-732436e3982a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.823352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d936e-40c3-4102-b0f7-732436e3982a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.824010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d936e-40c3-4102-b0f7-732436e3982a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:56.825796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d936e-40c3-4102-b0f7-732436e3982a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:56.837365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1114/2218] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:04:56.841514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:56.852142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f177edb-4b7c-4e98-90d9-d0a47f0dff02 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:56.857497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:56.858163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.858440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.858711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] PATH_INFO: `/v3/projects/98453936acf34883b2e5d71241da8ad3/users/8ecd3f3c90174a239ebb83b2323eb800/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.874803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98453936acf34883b2e5d71241da8ad3, user_id=8ecd3f3c90174a239ebb83b2323eb800, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:56.877530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:56.892686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1105/2219] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:04:56 2022] PUT /identity/v3/projects/98453936acf34883b2e5d71241da8ad3/users/8ecd3f3c90174a239ebb83b2323eb800/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:04:56.904071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:56.904526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:56.904915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:56.940149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] MFA Rules not processed for user `8ecd3f3c90174a239ebb83b2323eb800`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:04:56.942045 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:57.022666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1115/2220] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:04:57.033809 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:04:57.035655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:04:57.108060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc0c6-5b3e-4524-a19c-4f420d004286 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:04:57.112081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37b7bf-d184-4300-bf3d-fcb9d25c6926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:04:57.112693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b7bf-d184-4300-bf3d-fcb9d25c6926 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:04:57.113002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b7bf-d184-4300-bf3d-fcb9d25c6926 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:04:57.113272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37b7bf-d184-4300-bf3d-fcb9d25c6926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:04:57.122673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37b7bf-d184-4300-bf3d-fcb9d25c6926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:04:57.124138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37b7bf-d184-4300-bf3d-fcb9d25c6926 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:04:57.134279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1106/2221] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:01.990129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:01.991700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:02.069517 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de67aab-ae42-4b9d-a866-1667e6cdd181 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:02.074590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:02.075245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:02.075525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:02.075831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] PATH_INFO: `/v3/users/7a04a30694634afdbf85f923a439c7b4` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:02.077033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a04a30694634afdbf85f923a439c7b4)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:02.078983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:02.110868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:02.130869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a04a30694634afdbf85f923a439c7b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.137628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a04a30694634afdbf85f923a439c7b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.146311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a04a30694634afdbf85f923a439c7b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.146934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a04a30694634afdbf85f923a439c7b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.160618 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a04a30694634afdbf85f923a439c7b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.167351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1116/2222] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:05:01 2022] DELETE /identity/v3/users/7a04a30694634afdbf85f923a439c7b4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:02.171765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:02.172239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:02.172330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:02.192378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:02.193774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:02.269165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1107/2223] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:02.279046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:02.280524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:02.339066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663411ae-8c1b-47c3-9fdc-d6dbc4eae6dc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:02.342778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a3699-abf7-43d9-a102-babaac039957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:02.343392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3699-abf7-43d9-a102-babaac039957 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:02.343667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3699-abf7-43d9-a102-babaac039957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:02.343927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3699-abf7-43d9-a102-babaac039957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:02.354771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a3699-abf7-43d9-a102-babaac039957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:02.356352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a3699-abf7-43d9-a102-babaac039957 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:02.368196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1117/2224] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:02.668425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:02.669998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:02.693311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfee602-b3e2-4b42-ad7c-b3ff25e8ec6e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:02.702728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:02.704087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:02.704366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:02.704718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] PATH_INFO: `/v3/projects/a152fd431ae342a69fd405c4162501ba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:02.710762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a152fd431ae342a69fd405c4162501ba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:02.714689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:02.801320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a152fd431ae342a69fd405c4162501ba', 'request_id': 'req-011e716e-6d8a-437a-9f96-4c8f137e3c41'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.810219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a152fd431ae342a69fd405c4162501ba', 'request_id': 'req-011e716e-6d8a-437a-9f96-4c8f137e3c41'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.818177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a152fd431ae342a69fd405c4162501ba', 'request_id': 'req-011e716e-6d8a-437a-9f96-4c8f137e3c41'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.833694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] The token cache is being invalidate because project a152fd431ae342a69fd405c4162501ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:05:02.834047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.834647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-011e716e-6d8a-437a-9f96-4c8f137e3c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:02.836146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1108/2225] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:05:02 2022] DELETE /identity/v3/projects/a152fd431ae342a69fd405c4162501ba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:02.841149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30bb94-3dc3-4580-bc68-2eb2c09299cb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:02.841434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30bb94-3dc3-4580-bc68-2eb2c09299cb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:02.841705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30bb94-3dc3-4580-bc68-2eb2c09299cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:02.862729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ac30bb94-3dc3-4580-bc68-2eb2c09299cb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:02.864187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ac30bb94-3dc3-4580-bc68-2eb2c09299cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:02.952026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1118/2226] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:02.962397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fdb4-20b1-4d18-aaee-ea6f6b2ad691 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:02.962744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fdb4-20b1-4d18-aaee-ea6f6b2ad691 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:02.963099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fdb4-20b1-4d18-aaee-ea6f6b2ad691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:02.971248 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:02.989053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-57e4fdb4-20b1-4d18-aaee-ea6f6b2ad691 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:02.991286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57e4fdb4-20b1-4d18-aaee-ea6f6b2ad691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:03.004583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1109/2227] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:03.010716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30bb94-3dc3-4580-bc68-2eb2c09299cb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:03.025775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30bb94-3dc3-4580-bc68-2eb2c09299cb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:03.031161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:03.031812 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.032118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.032387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.033083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:05:03.033645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:03.035285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:03.055343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fdb4-20b1-4d18-aaee-ea6f6b2ad691 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:03.056999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1119/2228] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:05:03.069002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fdb4-20b1-4d18-aaee-ea6f6b2ad691 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:03.075952 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:03.076574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.076886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.077155 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.077804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:03.079759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:03.117185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1110/2229] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:05:03 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:05:03.124742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:03.136053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a6f7a-ad7e-4186-8319-e3298b5756f6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:03.174429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:03.209464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:03.210267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.210662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.211189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.211875 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:03.213920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:03.241585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1120/2230] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:05:03 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:05:03.244067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:03.257523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630df7a-5183-4186-a66a-68296273b525 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:03.262367 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:03.262979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.263252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.263515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.264165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:03.265790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:03.276161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1111/2231] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:05:03.280174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:03.294285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a5a3-92e3-446a-9b38-35b7c75923cb admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:03.300961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2febcc-57cb-4526-a743-8182b3db1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:03.301943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2febcc-57cb-4526-a743-8182b3db1c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.302524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2febcc-57cb-4526-a743-8182b3db1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.302869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2febcc-57cb-4526-a743-8182b3db1c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.303650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2febcc-57cb-4526-a743-8182b3db1c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:03.305363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2febcc-57cb-4526-a743-8182b3db1c5c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:03.317243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1121/2232] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:05:03.322567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:03.335051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ef5ed-89c6-40fd-a7e5-668041e2dba6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:03.340488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:03.341276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.341552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.341817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] PATH_INFO: `/v3/projects/5f95b677b09d4cf392c189812dae0bc3/users/bbd63ce3b38047d0b86b6e230b173863/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.359157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f95b677b09d4cf392c189812dae0bc3, user_id=bbd63ce3b38047d0b86b6e230b173863, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:03.361914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:03.376668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1112/2233] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:05:03 2022] PUT /identity/v3/projects/5f95b677b09d4cf392c189812dae0bc3/users/bbd63ce3b38047d0b86b6e230b173863/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:03.388785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08f25-f059-4203-956b-519ec557edfb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.388989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08f25-f059-4203-956b-519ec557edfb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.389295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08f25-f059-4203-956b-519ec557edfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.420688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d3e08f25-f059-4203-956b-519ec557edfb None None] MFA Rules not processed for user `bbd63ce3b38047d0b86b6e230b173863`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:03.421997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d3e08f25-f059-4203-956b-519ec557edfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:03.496246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1122/2234] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:03.507133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:03.508915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:03.576094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda521-e88c-4c78-bbf4-37f80303b0dd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:03.579859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:03.580486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:03.580759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:03.581054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:03.590750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:03.592457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:03.602217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1113/2235] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:04.986420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6230c-aa89-47f2-a353-d979640221b5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:04.987012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6230c-aa89-47f2-a353-d979640221b5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:04.987012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6230c-aa89-47f2-a353-d979640221b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:05.007443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f2f6230c-aa89-47f2-a353-d979640221b5 None None] MFA Rules not processed for user `bbd63ce3b38047d0b86b6e230b173863`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:05.008676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f2f6230c-aa89-47f2-a353-d979640221b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:05.016703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1123/2236] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:07.364579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:07.366312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:07.438861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a765df4-33dc-4d3c-8d2f-c1c4a31e99ef service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:07.444729 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:07.445941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:07.448839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:07.448839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] PATH_INFO: `/v3/users/8ecd3f3c90174a239ebb83b2323eb800` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:07.448839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecd3f3c90174a239ebb83b2323eb800)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:07.451459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:07.503373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecd3f3c90174a239ebb83b2323eb800'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:07.505396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:07.521683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecd3f3c90174a239ebb83b2323eb800'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:07.529750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecd3f3c90174a239ebb83b2323eb800'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:07.530474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecd3f3c90174a239ebb83b2323eb800'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:07.531074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecd3f3c90174a239ebb83b2323eb800'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:07.544885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1114/2237] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:05:07 2022] DELETE /identity/v3/users/8ecd3f3c90174a239ebb83b2323eb800 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:07.549395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:07.549910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:07.550014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:07.570518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:07.571738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:07.636503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1124/2238] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:07.646173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:07.647613 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:07.705899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fcf9a-69bb-4fbf-8b12-f0eaec88609a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:07.710815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b440-cd53-4582-a659-beccc3a2d58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:07.711558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b440-cd53-4582-a659-beccc3a2d58b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:07.712660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b440-cd53-4582-a659-beccc3a2d58b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:07.712660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b440-cd53-4582-a659-beccc3a2d58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:07.723599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b440-cd53-4582-a659-beccc3a2d58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:07.725101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b440-cd53-4582-a659-beccc3a2d58b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:07.736660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1115/2239] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:08.307673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:08.310828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:08.323475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef235d99-184f-48a2-987c-a60d78bee881 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:08.331535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:08.338069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:08.338446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:08.338787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] PATH_INFO: `/v3/projects/98453936acf34883b2e5d71241da8ad3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:08.340118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98453936acf34883b2e5d71241da8ad3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:08.342121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:08.383165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:08.398441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98453936acf34883b2e5d71241da8ad3', 'request_id': 'req-601bd6a0-0007-4e99-9610-811c811b6064'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:08.404209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98453936acf34883b2e5d71241da8ad3', 'request_id': 'req-601bd6a0-0007-4e99-9610-811c811b6064'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:08.412333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98453936acf34883b2e5d71241da8ad3', 'request_id': 'req-601bd6a0-0007-4e99-9610-811c811b6064'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:08.424044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] The token cache is being invalidate because project 98453936acf34883b2e5d71241da8ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:05:08.424367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:08.425814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:08.427623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1125/2240] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:05:08 2022] DELETE /identity/v3/projects/98453936acf34883b2e5d71241da8ad3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:17.732434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=39,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:18.421118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:23.683143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6df33-b749-4ebf-8fa8-9408ca877061 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:23.683670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6df33-b749-4ebf-8fa8-9408ca877061 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:23.683670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6df33-b749-4ebf-8fa8-9408ca877061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:23.704385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c5e6df33-b749-4ebf-8fa8-9408ca877061 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:23.705617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5e6df33-b749-4ebf-8fa8-9408ca877061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:23.768480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1116/2241] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:23.781198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:23.782682 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:23.854725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bd6a0-0007-4e99-9610-811c811b6064 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:23.860896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:23.861531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:23.861809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:23.862075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:23.870751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:23.872328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:23.880737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1126/2242] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:05:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:05:24.453780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e6c4b-7169-4f34-8a4d-472e15fb4620 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:24.454066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e6c4b-7169-4f34-8a4d-472e15fb4620 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:24.454337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e6c4b-7169-4f34-8a4d-472e15fb4620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:24.475124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3b8e6c4b-7169-4f34-8a4d-472e15fb4620 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:24.476407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3b8e6c4b-7169-4f34-8a4d-472e15fb4620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:24.484869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1117/2243] 10.222.0.89 () {58 vars in 967 bytes} [Tue Aug 30 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:24.497471 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:24.508319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d6f77-cfa7-493a-a236-7047418e03ad service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:24.514673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1922c-dc38-4011-890e-662275158256 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:24.515271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1922c-dc38-4011-890e-662275158256 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:24.515538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1922c-dc38-4011-890e-662275158256 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:24.515805 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1922c-dc38-4011-890e-662275158256 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:24.524178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1922c-dc38-4011-890e-662275158256 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:24.525785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1922c-dc38-4011-890e-662275158256 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:24.533819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1127/2244] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:05:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:05:24.765389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f707-37af-418e-8b23-5aec8921f5ad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:24.765880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f707-37af-418e-8b23-5aec8921f5ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:24.765880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f707-37af-418e-8b23-5aec8921f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:24.786276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e6c1f707-37af-418e-8b23-5aec8921f5ad None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:24.787405 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e6c1f707-37af-418e-8b23-5aec8921f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:24.796107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1118/2245] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:24.808644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1922c-dc38-4011-890e-662275158256 service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:24.819620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1922c-dc38-4011-890e-662275158256 service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:24.826228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:24.826849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:24.827120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:24.827386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:24.835864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:24.837537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:24.846060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1128/2246] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:05:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:05:25.212585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:25.212897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:25.213164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:25.234067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:25.235285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:25.242958 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1119/2247] 10.222.0.89 () {58 vars in 967 bytes} [Tue Aug 30 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:25.257326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:25.268613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b253a-5cac-4e46-97da-b32d938d0f10 service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:25.274183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a4025-a7ff-4d6f-b4c7-d224a4511788 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:25.275189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4025-a7ff-4d6f-b4c7-d224a4511788 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:25.275473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4025-a7ff-4d6f-b4c7-d224a4511788 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:25.275743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a4025-a7ff-4d6f-b4c7-d224a4511788 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:25.284291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4025-a7ff-4d6f-b4c7-d224a4511788 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:25.285918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a4025-a7ff-4d6f-b4c7-d224a4511788 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:25.294341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1129/2248] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:05:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:05:27.656862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:27.659881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:27.736254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d9a87-174a-40a0-8bf0-3f585563339f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:27.741501 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:27.742153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:27.742420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:27.742692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] PATH_INFO: `/v3/users/bbd63ce3b38047d0b86b6e230b173863` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:27.744201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd63ce3b38047d0b86b6e230b173863)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:27.746871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:27.801487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd63ce3b38047d0b86b6e230b173863'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:27.813427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd63ce3b38047d0b86b6e230b173863'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:27.820707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd63ce3b38047d0b86b6e230b173863'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:27.821506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd63ce3b38047d0b86b6e230b173863'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:27.822190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd63ce3b38047d0b86b6e230b173863'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:27.835737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1120/2249] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:05:27 2022] DELETE /identity/v3/users/bbd63ce3b38047d0b86b6e230b173863 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:27.840523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:27.841042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:27.841137 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:27.861477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:27.862703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:27.922863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1130/2250] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:27.935271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:27.936840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:27.943926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:28.000330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22448-f9f4-402a-a829-8aa3536082dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.004769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0546c-b575-4aa2-9e1f-7bf10f508f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.005443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0546c-b575-4aa2-9e1f-7bf10f508f98 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.005731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0546c-b575-4aa2-9e1f-7bf10f508f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.006006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0546c-b575-4aa2-9e1f-7bf10f508f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.015821 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0546c-b575-4aa2-9e1f-7bf10f508f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.017306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0546c-b575-4aa2-9e1f-7bf10f508f98 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.027336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1121/2251] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:28.204832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.206455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.219238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72cdf1-4abe-441b-9970-12b23ab42d1b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.224528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.225461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.225978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.226474 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] PATH_INFO: `/v3/projects/5f95b677b09d4cf392c189812dae0bc3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.228198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f95b677b09d4cf392c189812dae0bc3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.230401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.278245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:28.281711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f95b677b09d4cf392c189812dae0bc3', 'request_id': 'req-990f2644-0353-4d20-842f-c5a6fd736a77'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.288276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f95b677b09d4cf392c189812dae0bc3', 'request_id': 'req-990f2644-0353-4d20-842f-c5a6fd736a77'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.295473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f95b677b09d4cf392c189812dae0bc3', 'request_id': 'req-990f2644-0353-4d20-842f-c5a6fd736a77'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.306960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] The token cache is being invalidate because project 5f95b677b09d4cf392c189812dae0bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:05:28.307254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.307944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-990f2644-0353-4d20-842f-c5a6fd736a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.309494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1131/2252] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:05:28 2022] DELETE /identity/v3/projects/5f95b677b09d4cf392c189812dae0bc3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:28.314340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.314637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.314932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.336240 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:28.337550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.397392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1122/2253] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:28.406360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c70f6-cad3-4a23-9332-5e42a7d1c3ac None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.406644 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c70f6-cad3-4a23-9332-5e42a7d1c3ac None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.406921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c70f6-cad3-4a23-9332-5e42a7d1c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.428674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-092c70f6-cad3-4a23-9332-5e42a7d1c3ac None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:28.429939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-092c70f6-cad3-4a23-9332-5e42a7d1c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.432788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.434488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.438344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1132/2254] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:28.442497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c70f6-cad3-4a23-9332-5e42a7d1c3ac None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.447200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b65fa4-f792-4b65-b4fc-3b9812e595c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.452018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.452369 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c70f6-cad3-4a23-9332-5e42a7d1c3ac None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.452650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.452968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.453242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] PATH_INFO: `/v3/users/3bf1cda4befa4db9a2f05a116b62c03f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.454411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf1cda4befa4db9a2f05a116b62c03f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.456338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.457999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.458709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.458978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.459239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.459902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:05:28.460199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.461861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.474399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1133/2255] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:05:28.479353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.491505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56beb3a-725c-4ecf-9971-3f58a785c1d6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.497995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.498729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.499010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.499632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.500271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.502210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.509545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf1cda4befa4db9a2f05a116b62c03f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.522205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf1cda4befa4db9a2f05a116b62c03f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.529702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf1cda4befa4db9a2f05a116b62c03f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.530420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf1cda4befa4db9a2f05a116b62c03f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.531105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-737dff84-28f7-47ac-95db-d09e980953fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf1cda4befa4db9a2f05a116b62c03f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:28.537061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1134/2256] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:05:28 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:05:28.538139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.539968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.544945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1123/2257] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:05:28 2022] DELETE /identity/v3/users/3bf1cda4befa4db9a2f05a116b62c03f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:05:28.549127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.549590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.549997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.569736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:28.571060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.583711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:28.610759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009e36-96dd-4c6b-a682-657accbe8bf4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.634358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1124/2258] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:28.644534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.646001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.675817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.676428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.676699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.676994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.677635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.679607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.707759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1135/2259] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:05:28 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:05:28.707946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d501d6f-e3f3-4db4-b92a-631bc265b7d0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.709785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.711880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.712625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.712932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.713394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.720880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc5e32-2fc4-40bf-8176-e8f529965963 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.723134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.724594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.726365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.726967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.727245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.727513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.728227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.729987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.735286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1125/2260] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:05:28.740603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1136/2261] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:05:28.747865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.758857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e31ab-4000-4d81-a8e6-ac3832d144e4 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.764059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f934832-95f6-4b12-8aa7-97e6c2fa8566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.764669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934832-95f6-4b12-8aa7-97e6c2fa8566 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.764980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934832-95f6-4b12-8aa7-97e6c2fa8566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.765254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934832-95f6-4b12-8aa7-97e6c2fa8566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.765908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f934832-95f6-4b12-8aa7-97e6c2fa8566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.767549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f934832-95f6-4b12-8aa7-97e6c2fa8566 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.778575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1126/2262] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:05:28.782912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.794978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638248-8960-47ac-8ede-b52944c703b1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:28.800013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:28.800747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.801149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.801564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] PATH_INFO: `/v3/projects/e28733cab3684ea4a010221d1178c3cc/users/12e423fa37d44f69a00d356be967d593/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.818340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28733cab3684ea4a010221d1178c3cc, user_id=12e423fa37d44f69a00d356be967d593, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:28.821363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:28.823865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:28.839833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1137/2263] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:05:28 2022] PUT /identity/v3/projects/e28733cab3684ea4a010221d1178c3cc/users/12e423fa37d44f69a00d356be967d593/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:28.845490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:28.845772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:28.846055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:28.867231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:28.868561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:28.934121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1127/2264] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:28.943903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:28.945731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.006752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e60b9-3140-47d3-a465-d8340b69bf40 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.011456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8a326-cb99-4e41-9b50-2d9aef8488cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.012188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a326-cb99-4e41-9b50-2d9aef8488cc service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.012446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a326-cb99-4e41-9b50-2d9aef8488cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.012670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a326-cb99-4e41-9b50-2d9aef8488cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.022818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8a326-cb99-4e41-9b50-2d9aef8488cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.024923 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.025578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8a326-cb99-4e41-9b50-2d9aef8488cc service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.026902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.038724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1138/2265] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:29.041763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b23ba8-9ef6-4b0b-9178-e50cec57730e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.046675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.047385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.047745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.048093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] PATH_INFO: `/v3/projects/0d61317379214132936f3abaa14059e2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.049275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d61317379214132936f3abaa14059e2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.051562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.102539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:29.103929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d61317379214132936f3abaa14059e2', 'request_id': 'req-5335e1d5-ee0d-4299-8891-1bc585f0b73b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:29.112831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d61317379214132936f3abaa14059e2', 'request_id': 'req-5335e1d5-ee0d-4299-8891-1bc585f0b73b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:29.119178 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d61317379214132936f3abaa14059e2', 'request_id': 'req-5335e1d5-ee0d-4299-8891-1bc585f0b73b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:29.131878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] The token cache is being invalidate because project 0d61317379214132936f3abaa14059e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:05:29.132160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:29.132847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5335e1d5-ee0d-4299-8891-1bc585f0b73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:29.134571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1128/2266] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:05:29 2022] DELETE /identity/v3/projects/0d61317379214132936f3abaa14059e2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:29.140239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c58ff2-9870-4537-a958-c17176e7b250 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.140522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c58ff2-9870-4537-a958-c17176e7b250 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.140835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c58ff2-9870-4537-a958-c17176e7b250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.162249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-12c58ff2-9870-4537-a958-c17176e7b250 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:29.163620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-12c58ff2-9870-4537-a958-c17176e7b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.233530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1139/2267] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:29.241199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f40258-9c20-4e59-ba8a-1674c9c97afa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.241618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f40258-9c20-4e59-ba8a-1674c9c97afa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.242063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f40258-9c20-4e59-ba8a-1674c9c97afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.264539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-77f40258-9c20-4e59-ba8a-1674c9c97afa None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:29.265899 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-77f40258-9c20-4e59-ba8a-1674c9c97afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.274108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1129/2268] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:29.278325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c58ff2-9870-4537-a958-c17176e7b250 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.288146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c58ff2-9870-4537-a958-c17176e7b250 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.293189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.293809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.294084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.294353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.295002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:05:29.295301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.296907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.309914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1140/2269] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:05:29.314280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f40258-9c20-4e59-ba8a-1674c9c97afa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.324975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f40258-9c20-4e59-ba8a-1674c9c97afa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.334000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.334712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.335059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.335397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.336128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.338316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.369409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1130/2270] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:05:29 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:05:29.376045 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.390665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341bb0-4a2c-44f8-81d6-4960954edf7c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.457711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.458353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.458633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.459002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.459790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.464131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.489314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1141/2271] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:05:29 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:05:29.493607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.505891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff78ad7-0475-44b7-90ef-6fe2d6e4295e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.510598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.511243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.511536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.511806 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.512471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.514205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.525233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1131/2272] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:05:29.529574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.539642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba13ec-5435-4a8c-b756-4111caeb5bbf admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.544711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d4360-22fb-42cf-902b-63a33a11d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.545354 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4360-22fb-42cf-902b-63a33a11d03c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.545628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4360-22fb-42cf-902b-63a33a11d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.545895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4360-22fb-42cf-902b-63a33a11d03c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.546560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d4360-22fb-42cf-902b-63a33a11d03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.548147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d4360-22fb-42cf-902b-63a33a11d03c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.559476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1142/2273] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:05:29.563914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.575131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5874-4ec2-46da-ab52-a6ab72a66cb0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.580553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980b9c-9a6d-47b7-8ce2-dd62472df0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.581271 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980b9c-9a6d-47b7-8ce2-dd62472df0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.581547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980b9c-9a6d-47b7-8ce2-dd62472df0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.581813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980b9c-9a6d-47b7-8ce2-dd62472df0bd admin admin] PATH_INFO: `/v3/projects/06226c025e3d4edfba3a50eeca636140/users/76b9b90ec43e478d9f2f7e3472df8b5b/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.598118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b980b9c-9a6d-47b7-8ce2-dd62472df0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=06226c025e3d4edfba3a50eeca636140, user_id=76b9b90ec43e478d9f2f7e3472df8b5b, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.600845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b980b9c-9a6d-47b7-8ce2-dd62472df0bd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.617063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1132/2274] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:05:29 2022] PUT /identity/v3/projects/06226c025e3d4edfba3a50eeca636140/users/76b9b90ec43e478d9f2f7e3472df8b5b/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:29.628754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.629147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.629483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.637519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:29.660892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] MFA Rules not processed for user `76b9b90ec43e478d9f2f7e3472df8b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:29.662117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.738609 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaba5a-d312-4dc7-a274-6a16d6c547c3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.739183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaba5a-d312-4dc7-a274-6a16d6c547c3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.739395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1143/2275] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:29.743238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaba5a-d312-4dc7-a274-6a16d6c547c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.752596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.758797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.785603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-faaaba5a-d312-4dc7-a274-6a16d6c547c3 None None] MFA Rules not processed for user `12e423fa37d44f69a00d356be967d593`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:29.787551 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-faaaba5a-d312-4dc7-a274-6a16d6c547c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.822473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b238845-3f0c-4cdf-8ea3-f0481226f8b6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.826454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.827088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.827361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.827625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.837192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.838802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.848788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1144/2276] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:29.862316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1133/2277] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:29.877951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.879593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:29.879984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaba5a-d312-4dc7-a274-6a16d6c547c3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:29.891393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef10-70e5-4025-b9a9-511956caf1db service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.895529 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b79a7-883e-4679-8dc2-52f46c0b923b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.896633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b79a7-883e-4679-8dc2-52f46c0b923b service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.896633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b79a7-883e-4679-8dc2-52f46c0b923b service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.896633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b79a7-883e-4679-8dc2-52f46c0b923b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.908041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b79a7-883e-4679-8dc2-52f46c0b923b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.909735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b79a7-883e-4679-8dc2-52f46c0b923b service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.921251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1145/2278] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:29.956928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaba5a-d312-4dc7-a274-6a16d6c547c3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:29.961710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:29.962584 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:29.962872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:29.963140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] PATH_INFO: `/v3/users/76b9b90ec43e478d9f2f7e3472df8b5b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:29.964478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b9b90ec43e478d9f2f7e3472df8b5b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:29.966436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:29.969002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:30.016377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b9b90ec43e478d9f2f7e3472df8b5b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.029044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b9b90ec43e478d9f2f7e3472df8b5b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.036691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b9b90ec43e478d9f2f7e3472df8b5b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.039301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b9b90ec43e478d9f2f7e3472df8b5b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.039960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b9b90ec43e478d9f2f7e3472df8b5b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.054965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1134/2279] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:05:29 2022] DELETE /identity/v3/users/76b9b90ec43e478d9f2f7e3472df8b5b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:05:30.059856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:30.060376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:30.060376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:30.079842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:30.081099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:30.150345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1146/2280] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:30.161414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:30.163069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:30.245437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda45304-0321-431f-af82-ccb580d7965f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:30.252350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc5e09-0d9c-4d66-8748-ec41739da992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:30.253117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc5e09-0d9c-4d66-8748-ec41739da992 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:30.253341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc5e09-0d9c-4d66-8748-ec41739da992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:30.253627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc5e09-0d9c-4d66-8748-ec41739da992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:30.263770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc5e09-0d9c-4d66-8748-ec41739da992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:30.265287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc5e09-0d9c-4d66-8748-ec41739da992 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:30.275375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1135/2281] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:30.626192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:30.628228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:30.653574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5dd8d-fe4b-4d34-87cb-6cbc7ebead1a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:30.659693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:30.660488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:30.660927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:30.661295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] PATH_INFO: `/v3/projects/06226c025e3d4edfba3a50eeca636140` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:30.663040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06226c025e3d4edfba3a50eeca636140)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:30.665288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:30.683109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:30.717155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06226c025e3d4edfba3a50eeca636140', 'request_id': 'req-4caf56df-22d0-461f-bb03-99a260b6df78'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.723173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06226c025e3d4edfba3a50eeca636140', 'request_id': 'req-4caf56df-22d0-461f-bb03-99a260b6df78'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.733173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06226c025e3d4edfba3a50eeca636140', 'request_id': 'req-4caf56df-22d0-461f-bb03-99a260b6df78'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.746590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] The token cache is being invalidate because project 06226c025e3d4edfba3a50eeca636140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:05:30.746967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.747650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4caf56df-22d0-461f-bb03-99a260b6df78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:05:30.749581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1147/2282] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:05:30 2022] DELETE /identity/v3/projects/06226c025e3d4edfba3a50eeca636140 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:05:31.336152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc85b3-5306-4af4-a21f-29fff979c236 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:31.336707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc85b3-5306-4af4-a21f-29fff979c236 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:31.336707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc85b3-5306-4af4-a21f-29fff979c236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:31.362937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2dbc85b3-5306-4af4-a21f-29fff979c236 None None] MFA Rules not processed for user `12e423fa37d44f69a00d356be967d593`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:31.364167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2dbc85b3-5306-4af4-a21f-29fff979c236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:31.427621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1136/2283] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:32.364961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c46e6-8980-463e-b335-dd21178b107a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:32.365426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c46e6-8980-463e-b335-dd21178b107a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:32.365426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c46e6-8980-463e-b335-dd21178b107a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:32.366785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1148/2284] 10.222.0.89 () {54 vars in 961 bytes} [Tue Aug 30 01:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:32.373216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:32.373673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:32.373790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:32.394853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] MFA Rules not processed for user `28a10c7731a84a4589c366c4963c1251`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:32.396072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:32.423512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:32.468420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1137/2285] 10.222.0.89 () {58 vars in 1058 bytes} [Tue Aug 30 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:32.478310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c46e6-8980-463e-b335-dd21178b107a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:32.492239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c46e6-8980-463e-b335-dd21178b107a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:32.497750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d76b5a-92c6-4e7e-adaa-97bff35e8e7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:32.498428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76b5a-92c6-4e7e-adaa-97bff35e8e7f service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:32.498762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76b5a-92c6-4e7e-adaa-97bff35e8e7f service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:32.499023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d76b5a-92c6-4e7e-adaa-97bff35e8e7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:32.501021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a1d76b5a-92c6-4e7e-adaa-97bff35e8e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:32.513651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d76b5a-92c6-4e7e-adaa-97bff35e8e7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:32.515258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d76b5a-92c6-4e7e-adaa-97bff35e8e7f service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:32.524749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:32.526245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1149/2286] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:05:32.526387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:32.539366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4b80a-ab6b-4b73-89f5-69f17263f5d7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:32.545264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06fcec-7f30-4935-bd05-cc2fbfcbd0af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:32.545874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06fcec-7f30-4935-bd05-cc2fbfcbd0af service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:32.546143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06fcec-7f30-4935-bd05-cc2fbfcbd0af service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:32.546402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06fcec-7f30-4935-bd05-cc2fbfcbd0af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:32.555020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06fcec-7f30-4935-bd05-cc2fbfcbd0af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:32.557117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06fcec-7f30-4935-bd05-cc2fbfcbd0af service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:32.568659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1138/2287] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:05:42.521269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:42.564068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=22 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:50.295932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:50.296488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:50.296488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:50.316611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] MFA Rules not processed for user `ec329f81679e4ffa83174d621b4440d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:50.317882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:50.382110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1150/2288] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:00.373109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=25 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:12.157876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73294-248f-4c31-88c0-c04bb9d9591c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:12.158623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73294-248f-4c31-88c0-c04bb9d9591c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:12.158623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73294-248f-4c31-88c0-c04bb9d9591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:12.187022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4cd73294-248f-4c31-88c0-c04bb9d9591c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:12.188830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4cd73294-248f-4c31-88c0-c04bb9d9591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:12.255239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1139/2289] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:12.272338 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:12.273919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:12.352738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5156f6-e8c4-40c3-886e-96fb5280e075 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:12.361739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:12.362365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:12.362636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:12.362895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:12.371950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:12.373608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:12.383506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1151/2290] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:17.263886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160a11-3ff6-4589-8499-27daa70b0532 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:17.264500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160a11-3ff6-4589-8499-27daa70b0532 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:17.264500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160a11-3ff6-4589-8499-27daa70b0532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:17.285787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d4160a11-3ff6-4589-8499-27daa70b0532 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:17.287287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d4160a11-3ff6-4589-8499-27daa70b0532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:17.296373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1140/2291] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:17.318913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:17.331700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70958b8-74a0-481f-9a9f-3bf7a66ea854 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:17.338759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:17.339365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:17.339642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:17.339914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:17.348828 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:17.350843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:17.361239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1152/2292] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:18.926315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e40b7-f5a5-4d6b-aa8e-a7c65987dfa1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:18.927575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e40b7-f5a5-4d6b-aa8e-a7c65987dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:18.927575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e40b7-f5a5-4d6b-aa8e-a7c65987dfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:18.948063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-402e40b7-f5a5-4d6b-aa8e-a7c65987dfa1 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:18.948905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-402e40b7-f5a5-4d6b-aa8e-a7c65987dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:19.013146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1141/2293] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:19.036222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:19.037725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:19.109613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0472f11-2ffb-4b38-9151-336772b0795a service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:19.117286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:19.117907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:19.118185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:19.118456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:19.127255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:19.128866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:19.137375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1153/2294] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:21.699357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abcb31-2641-41cf-a552-58b46bbc9b34 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:21.700018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abcb31-2641-41cf-a552-58b46bbc9b34 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:21.700260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abcb31-2641-41cf-a552-58b46bbc9b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:21.730403 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a1abcb31-2641-41cf-a552-58b46bbc9b34 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:21.731708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a1abcb31-2641-41cf-a552-58b46bbc9b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:21.758085 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1142/2295] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:21.782620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:21.784081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:21.800488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9feb7-7801-42b5-ac41-e836c7a284ff service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:21.806780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:21.807448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:21.807720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:21.807985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:21.818008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:21.821649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:21.835468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1154/2296] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:25.860434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d70195-4da3-4243-a3e9-0c000e4ff623 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:25.861104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d70195-4da3-4243-a3e9-0c000e4ff623 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:25.861104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d70195-4da3-4243-a3e9-0c000e4ff623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:25.884444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-38d70195-4da3-4243-a3e9-0c000e4ff623 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:25.885785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-38d70195-4da3-4243-a3e9-0c000e4ff623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:25.894241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1143/2297] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:25.909406 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:25.922225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571aeda-24db-4fd6-a816-ef4e014cbb10 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:25.929621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:25.930538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:25.930784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:25.931163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:25.942335 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:25.944321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:25.955833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1155/2298] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:30.084525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac60d53-a240-453f-8c43-04ac99086a02 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:30.085121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac60d53-a240-453f-8c43-04ac99086a02 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:30.085121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac60d53-a240-453f-8c43-04ac99086a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:30.105184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5ac60d53-a240-453f-8c43-04ac99086a02 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:30.106377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5ac60d53-a240-453f-8c43-04ac99086a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:30.114145 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1144/2299] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:30.151422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:30.165607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d8443-7098-487e-88b6-01e1683c93f4 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:30.176378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:30.177213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:30.177521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:30.177823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:30.187061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:30.188628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:30.198681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1156/2300] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:36.360460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b35d-a13c-4a32-9b31-87e35a5f657e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.361016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b35d-a13c-4a32-9b31-87e35a5f657e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.361016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b35d-a13c-4a32-9b31-87e35a5f657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.371122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=65 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:36.383252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9364b35d-a13c-4a32-9b31-87e35a5f657e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:36.384441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9364b35d-a13c-4a32-9b31-87e35a5f657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:36.393123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1145/2301] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:36.410051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:36.423806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370eb42-0d6f-482b-ac3e-616cf01d3723 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:36.430341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37617c-61dd-48ff-911e-9c070bf61036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:36.431181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37617c-61dd-48ff-911e-9c070bf61036 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.431596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37617c-61dd-48ff-911e-9c070bf61036 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.431991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37617c-61dd-48ff-911e-9c070bf61036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.441953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37617c-61dd-48ff-911e-9c070bf61036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:36.443997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37617c-61dd-48ff-911e-9c070bf61036 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:36.455315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1157/2302] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:36.708481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdad9f-8434-4c85-93d0-c99b63ef02cf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.708847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdad9f-8434-4c85-93d0-c99b63ef02cf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.709124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdad9f-8434-4c85-93d0-c99b63ef02cf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.710793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1146/2303] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:36.718598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ebb6-02f5-4998-a4de-efa71001eb5a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.718987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ebb6-02f5-4998-a4de-efa71001eb5a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.719270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ebb6-02f5-4998-a4de-efa71001eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.740976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5477ebb6-02f5-4998-a4de-efa71001eb5a None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:36.742214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5477ebb6-02f5-4998-a4de-efa71001eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:36.755036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1158/2304] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:36.767595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdad9f-8434-4c85-93d0-c99b63ef02cf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:36.769396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e8cdad9f-8434-4c85-93d0-c99b63ef02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:36.829372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdad9f-8434-4c85-93d0-c99b63ef02cf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:36.838225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cbd4a-8ac6-4c18-a133-74adcf02717a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:36.838901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbd4a-8ac6-4c18-a133-74adcf02717a service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.839179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbd4a-8ac6-4c18-a133-74adcf02717a service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.839444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cbd4a-8ac6-4c18-a133-74adcf02717a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.850820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cbd4a-8ac6-4c18-a133-74adcf02717a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:36.852255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cbd4a-8ac6-4c18-a133-74adcf02717a service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:36.863223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1147/2305] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:36.946760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35722207-7da9-452d-b47b-4e569dd0b081 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.947210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35722207-7da9-452d-b47b-4e569dd0b081 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.947473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35722207-7da9-452d-b47b-4e569dd0b081 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.948848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1159/2306] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:36.954061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83ac6-f169-4745-90bd-9aa2ed2c1f0b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.954374 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83ac6-f169-4745-90bd-9aa2ed2c1f0b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.954646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83ac6-f169-4745-90bd-9aa2ed2c1f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.975615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-01c83ac6-f169-4745-90bd-9aa2ed2c1f0b None None] MFA Rules not processed for user `5007fe05c96e468b9dbc9b22ff1e2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:36.976966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-01c83ac6-f169-4745-90bd-9aa2ed2c1f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:37.031008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1148/2307] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:37.046492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35722207-7da9-452d-b47b-4e569dd0b081 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:37.048638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-35722207-7da9-452d-b47b-4e569dd0b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:37.057321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:37.063890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35722207-7da9-452d-b47b-4e569dd0b081 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:37.067591 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d278b-82ac-4df2-b634-a99c6e3a7174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:37.068189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d278b-82ac-4df2-b634-a99c6e3a7174 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:37.068469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d278b-82ac-4df2-b634-a99c6e3a7174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:37.068736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d278b-82ac-4df2-b634-a99c6e3a7174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:37.075929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d278b-82ac-4df2-b634-a99c6e3a7174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:37.077402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d278b-82ac-4df2-b634-a99c6e3a7174 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:37.085232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1160/2308] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:37.170527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1f21d-c61c-4384-a7fb-caa82c181a1e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:37.170978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1f21d-c61c-4384-a7fb-caa82c181a1e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:37.171385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1f21d-c61c-4384-a7fb-caa82c181a1e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:37.173230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1149/2309] 10.222.0.89 () {54 vars in 921 bytes} [Tue Aug 30 01:06:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:37.179083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b609-cd8e-464e-a4ab-36aa29779036 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:37.179464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b609-cd8e-464e-a4ab-36aa29779036 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:37.179708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b609-cd8e-464e-a4ab-36aa29779036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:37.202227 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6210b609-cd8e-464e-a4ab-36aa29779036 None None] MFA Rules not processed for user `e9a6ec078043424aa591043afcc32c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:37.203482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6210b609-cd8e-464e-a4ab-36aa29779036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:37.215701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1161/2310] 10.222.0.89 () {58 vars in 1018 bytes} [Tue Aug 30 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:37.229652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1f21d-c61c-4384-a7fb-caa82c181a1e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:37.231920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f6d1f21d-c61c-4384-a7fb-caa82c181a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:37.247451 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1f21d-c61c-4384-a7fb-caa82c181a1e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:37.251563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:37.252144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:37.252425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:37.252684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:37.263815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:37.265287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:37.275861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1150/2311] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:40.743899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122c1e-4f41-438a-a49a-b6ece8309ce5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:40.744626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122c1e-4f41-438a-a49a-b6ece8309ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:40.744626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122c1e-4f41-438a-a49a-b6ece8309ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:40.771983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4e122c1e-4f41-438a-a49a-b6ece8309ce5 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:40.773299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4e122c1e-4f41-438a-a49a-b6ece8309ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:40.786232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1162/2312] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:40.801035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:40.815567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64d376-d658-4d1f-a0d9-8afd96c1f83b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:40.822087 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:40.823108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:40.823578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:40.824053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:40.837891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:40.840019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:40.850659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1151/2313] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:06:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:50.765116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=11 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:50.846972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=63 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:08.040233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07844205-f79f-42d0-8ac0-3939193ba6f8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:08.040817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07844205-f79f-42d0-8ac0-3939193ba6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:08.040817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07844205-f79f-42d0-8ac0-3939193ba6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:08.064272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-07844205-f79f-42d0-8ac0-3939193ba6f8 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:08.065933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-07844205-f79f-42d0-8ac0-3939193ba6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:08.074414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1163/2314] 10.222.0.89 () {58 vars in 967 bytes} [Tue Aug 30 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:08.096969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:08.109227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6aac-e0e1-4932-a2fc-38cade4c009d service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:08.116231 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944af1b-c7d3-4814-8af7-09f8ff114ecc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:08.118206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944af1b-c7d3-4814-8af7-09f8ff114ecc service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:08.119063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944af1b-c7d3-4814-8af7-09f8ff114ecc service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:08.119537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944af1b-c7d3-4814-8af7-09f8ff114ecc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:08.132163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944af1b-c7d3-4814-8af7-09f8ff114ecc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:08.134880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944af1b-c7d3-4814-8af7-09f8ff114ecc service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:08.148602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1152/2315] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:07:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:12.166323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157380-e714-4ea9-a59d-48ff4c3e69e9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:12.166878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157380-e714-4ea9-a59d-48ff4c3e69e9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:12.166878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157380-e714-4ea9-a59d-48ff4c3e69e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:12.187305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9a157380-e714-4ea9-a59d-48ff4c3e69e9 None None] MFA Rules not processed for user `12e423fa37d44f69a00d356be967d593`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:12.188521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9a157380-e714-4ea9-a59d-48ff4c3e69e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:12.197221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1164/2316] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:18.142687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:22.181511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:23.813127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dab18-4b0c-4939-a736-979cb4c8cacf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:23.813743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dab18-4b0c-4939-a736-979cb4c8cacf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:23.813743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dab18-4b0c-4939-a736-979cb4c8cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:23.840591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5b4dab18-4b0c-4939-a736-979cb4c8cacf None None] MFA Rules not processed for user `40ed6647aea94ff9b717b79a34faa3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:23.842437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b4dab18-4b0c-4939-a736-979cb4c8cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:23.903263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1153/2317] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:32.122837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd644-1bf3-44f6-9b35-36e7e3f5cbed None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:32.123447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd644-1bf3-44f6-9b35-36e7e3f5cbed None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:32.123447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd644-1bf3-44f6-9b35-36e7e3f5cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:32.144736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3fafd644-1bf3-44f6-9b35-36e7e3f5cbed None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:32.145958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3fafd644-1bf3-44f6-9b35-36e7e3f5cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:32.154424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1165/2318] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:32.180105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dab18-4b0c-4939-a736-979cb4c8cacf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:32.194919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dab18-4b0c-4939-a736-979cb4c8cacf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:32.200776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:32.201397 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:32.201672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:32.201938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:32.210986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:32.212878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:32.223100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1154/2319] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:36.453114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca1c10-7882-4941-b349-448ef0bb49f3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:36.453684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca1c10-7882-4941-b349-448ef0bb49f3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:36.453684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca1c10-7882-4941-b349-448ef0bb49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:36.475057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-28ca1c10-7882-4941-b349-448ef0bb49f3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:36.476254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-28ca1c10-7882-4941-b349-448ef0bb49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:36.485754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1166/2320] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:36.501577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:36.513349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d0ed0-6f76-46b0-97a1-468fa3d45c3c service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:36.519450 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:36.520039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:36.520311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:36.520575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:36.529150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:36.530773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:36.540343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1155/2321] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:40.563200 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ca2e-1a23-43ab-b4b5-b48d18807319 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:40.563718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ca2e-1a23-43ab-b4b5-b48d18807319 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:40.563718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ca2e-1a23-43ab-b4b5-b48d18807319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:40.590803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-74b9ca2e-1a23-43ab-b4b5-b48d18807319 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:40.592053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-74b9ca2e-1a23-43ab-b4b5-b48d18807319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:40.602108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1167/2322] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:40.619159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:40.631548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88939e-e72e-46f2-8408-8bac0bb9df83 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:40.639034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c34b63-5b2c-408a-8bbb-68431d7536ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:40.639638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34b63-5b2c-408a-8bbb-68431d7536ce service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:40.639920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34b63-5b2c-408a-8bbb-68431d7536ce service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:40.640182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c34b63-5b2c-408a-8bbb-68431d7536ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:40.649038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c34b63-5b2c-408a-8bbb-68431d7536ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:40.650761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c34b63-5b2c-408a-8bbb-68431d7536ce service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:40.660611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1156/2323] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:41.470187 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9ca2e-1a23-43ab-b4b5-b48d18807319 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:41.481128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9ca2e-1a23-43ab-b4b5-b48d18807319 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:41.485607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:41.486216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:41.486487 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:41.486754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:41.488933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:41.506102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:41.507536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:41.519690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1168/2324] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:44.785838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5bdd4-55de-42f8-adc8-688e3cce62e8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:44.786351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5bdd4-55de-42f8-adc8-688e3cce62e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:44.786351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5bdd4-55de-42f8-adc8-688e3cce62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:44.808733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b5d5bdd4-55de-42f8-adc8-688e3cce62e8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:44.809975 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b5d5bdd4-55de-42f8-adc8-688e3cce62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:44.820089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1157/2325] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:44.846064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:44.858867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5e7a-a83c-444d-87b4-fee9e773bb09 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:44.866292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5246f9e-31cb-4629-b418-bacb0285343e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:44.866887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246f9e-31cb-4629-b418-bacb0285343e service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:44.867157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246f9e-31cb-4629-b418-bacb0285343e service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:44.867420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246f9e-31cb-4629-b418-bacb0285343e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:44.876373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5246f9e-31cb-4629-b418-bacb0285343e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:44.878075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5246f9e-31cb-4629-b418-bacb0285343e service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:44.888155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1169/2326] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:07:49.027808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5bdd4-55de-42f8-adc8-688e3cce62e8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:49.035771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=47 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:49.042936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5bdd4-55de-42f8-adc8-688e3cce62e8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:49.046893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:49.047488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:49.047760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:49.048033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:49.050091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:49.066092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:49.067927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:49.079326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1158/2327] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:50.044631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aeac9-fdce-4d73-9b91-28e75fbf9333 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:50.045209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aeac9-fdce-4d73-9b91-28e75fbf9333 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:50.045209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aeac9-fdce-4d73-9b91-28e75fbf9333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:50.067630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ad9aeac9-fdce-4d73-9b91-28e75fbf9333 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:50.068841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ad9aeac9-fdce-4d73-9b91-28e75fbf9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:50.081042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1170/2328] 10.222.0.88 () {58 vars in 1016 bytes} [Tue Aug 30 01:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:50.098315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:50.110475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af3270-a695-4512-b21f-a8291cc0e889 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:50.116835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f0537-df2e-4851-890d-ffb07fd98d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:50.117389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0537-df2e-4851-890d-ffb07fd98d22 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:50.117666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0537-df2e-4851-890d-ffb07fd98d22 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:50.117939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0537-df2e-4851-890d-ffb07fd98d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:50.126444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f0537-df2e-4851-890d-ffb07fd98d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:50.128037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f0537-df2e-4851-890d-ffb07fd98d22 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:50.137591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1159/2329] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:56.540894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aeac9-fdce-4d73-9b91-28e75fbf9333 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:56.547929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=25 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:56.560333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aeac9-fdce-4d73-9b91-28e75fbf9333 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:56.568760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:56.572391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:56.572772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:56.573940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:56.576327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:56.589621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:56.591781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:56.603039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1171/2330] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:00.133442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=11 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:06.597902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:11.304618 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903866b-2c97-49e2-969c-148aec3b2cd2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:11.305719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903866b-2c97-49e2-969c-148aec3b2cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:11.305991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903866b-2c97-49e2-969c-148aec3b2cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:11.325212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5903866b-2c97-49e2-969c-148aec3b2cd2 None None] MFA Rules not processed for user `ec329f81679e4ffa83174d621b4440d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:11.326422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5903866b-2c97-49e2-969c-148aec3b2cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:11.333463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1160/2331] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:11.660977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:11.670893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97c7ca-bda8-47c8-ac42-d497a89b7069 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:11.675082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:11.675708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:11.675987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:11.676254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:11.679241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:11.690031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:11.691485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:11.700516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1172/2332] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:12.030548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903866b-2c97-49e2-969c-148aec3b2cd2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:12.044713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903866b-2c97-49e2-969c-148aec3b2cd2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:12.050777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:12.051592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:12.051867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:12.052133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:12.053984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:12.067411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:12.069230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:12.079880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1161/2333] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:14.308083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:14.318159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dad736-5144-4f8b-b948-09da1fd8aa47 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:14.322701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:14.323606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:14.324080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:14.324522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:14.326346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:14.337209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:14.338669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:14.347814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1173/2334] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:14.945669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:14.960017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32680c-ded7-43d1-8cd1-92d4cd1df2c1 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:14.968169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:14.969097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:14.969373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:14.969638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:14.971841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:14.986135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:14.987962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:15.002671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1162/2335] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:20.206986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:20.227891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0258f-32e0-4711-8574-837aa613ecf5 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:20.234467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:20.235122 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:20.235399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:20.235668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:20.237731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:20.257725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:20.259425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:20.272311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1174/2336] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:23.964863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:23.979419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ffad-b0b2-4e7d-be99-941933bc5974 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:23.985600 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:23.986473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:23.986989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:23.987457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:23.989474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:24.009033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:24.011719 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:24.036722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1163/2337] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:24.040413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:24.041888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:24.063350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f9ff5-050e-4f62-b6bd-fc6824283f05 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:24.068866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:24.070033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:24.070310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:24.070579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] PATH_INFO: `/v3/users/12e423fa37d44f69a00d356be967d593` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:24.072274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e423fa37d44f69a00d356be967d593)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:24.074849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:24.131546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e423fa37d44f69a00d356be967d593'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.140462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e423fa37d44f69a00d356be967d593'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.151458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e423fa37d44f69a00d356be967d593'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.152507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e423fa37d44f69a00d356be967d593'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.166214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e423fa37d44f69a00d356be967d593'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.173170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1175/2338] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:08:24 2022] DELETE /identity/v3/users/12e423fa37d44f69a00d356be967d593 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:08:24.387825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:24.401625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171fd69-360f-4901-b6ac-dbc54f5600f3 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:24.488623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:24.489925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:24.490495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:24.491249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] PATH_INFO: `/v3/projects/e28733cab3684ea4a010221d1178c3cc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:24.493877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28733cab3684ea4a010221d1178c3cc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:24.497827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:24.565324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28733cab3684ea4a010221d1178c3cc', 'request_id': 'req-6a172a06-4555-43ff-ab63-c2f87ea8e20c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.572598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28733cab3684ea4a010221d1178c3cc', 'request_id': 'req-6a172a06-4555-43ff-ab63-c2f87ea8e20c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.582749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28733cab3684ea4a010221d1178c3cc', 'request_id': 'req-6a172a06-4555-43ff-ab63-c2f87ea8e20c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.603934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] The token cache is being invalidate because project e28733cab3684ea4a010221d1178c3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:08:24.604234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.604940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a172a06-4555-43ff-ab63-c2f87ea8e20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:08:24.606838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1164/2339] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:08:24 2022] DELETE /identity/v3/projects/e28733cab3684ea4a010221d1178c3cc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:08:25.980854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:25.982412 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:26.069837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe035-6ca4-4c3c-ba04-41cf76d839fb admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:26.103446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:26.142601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:26.143236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:26.143514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:26.143788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:26.145733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:26.204116 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:26.205760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:26.216015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1176/2340] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:34.597642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:34.658135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:34.658429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:34.658699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:34.679281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] MFA Rules not processed for user `e2b354bfe62742e3bce1b8ec7eb85e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:34.680156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:34.687874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1165/2341] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:08:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:35.011791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:35.013922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:35.079564 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90468b-8972-4442-9e8b-0aa5489bf0bc service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:35.086736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:35.087375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:35.087654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:35.087921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:35.089950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:35.101009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:35.102660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:35.110929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1177/2342] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:36.682363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:36.684738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:36.749495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf938c18-b55f-4952-911d-3ad7c57aff77 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:36.753268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:36.753885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:36.755077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:36.755077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:36.756711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:36.822877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:36.824264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:36.835580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1166/2343] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:45.107248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=68 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:46.829525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=51 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:50.130979 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:50.134243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:50.166984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83b88-8e65-46f7-a2b5-e8a7fbfaf763 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:50.176044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:50.176914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:50.177421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:50.177960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:50.180065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:50.195624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:50.197664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:50.228341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1178/2344] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:57.844927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:57.847337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:57.864842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9817f-32e3-4cae-8b6a-f8525f145dfc service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:57.869624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a199f-c329-426d-b6dd-84fafeda6485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:57.870569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a199f-c329-426d-b6dd-84fafeda6485 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:57.870874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a199f-c329-426d-b6dd-84fafeda6485 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:57.871146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a199f-c329-426d-b6dd-84fafeda6485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:57.873293 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cd7a199f-c329-426d-b6dd-84fafeda6485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:57.942310 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a199f-c329-426d-b6dd-84fafeda6485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:57.943790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a199f-c329-426d-b6dd-84fafeda6485 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:57.954238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1167/2345] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:00.205183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:01.346541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:01.349240 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:01.374815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da580-25ff-4704-a877-fe3b8a1a59cf service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:01.380169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:01.381002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:01.381322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:01.381603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:01.384049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:01.503258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:01.506261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:01.526371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1179/2346] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:05.773007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:05.774074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:05.774619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:05.802754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] MFA Rules not processed for user `b6b474e9ef2e49b3a27b73d8ffd385b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:05.804188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:05.808076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:05.811606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:05.815700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1168/2347] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:05.892559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:05.894758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:05.922877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea516fc-f0cf-40d7-95a5-4629de19aefe service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:05.926380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef0d2-f0af-4094-8e6f-ae4924992168 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:05.928309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:05.929086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:05.929429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:05.929775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:05.932568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:05.932717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:05.933381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:05.934210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:05.934210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] PATH_INFO: `/v3/users/40ed6647aea94ff9b717b79a34faa3e7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:05.935714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ed6647aea94ff9b717b79a34faa3e7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:05.938131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:05.947148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:05.951844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:05.963657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1180/2348] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:06.019956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ed6647aea94ff9b717b79a34faa3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.038066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ed6647aea94ff9b717b79a34faa3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.046413 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ed6647aea94ff9b717b79a34faa3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.047507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ed6647aea94ff9b717b79a34faa3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.048368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fa75611a-8d90-491f-8151-36e1b4646aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ed6647aea94ff9b717b79a34faa3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.071490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1169/2349] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:09:05 2022] DELETE /identity/v3/users/40ed6647aea94ff9b717b79a34faa3e7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:06.285269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:06.305608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ef741-76b0-4b6a-b8b7-ae019cc68ac7 service placement] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:06.384030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:06.384721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.385033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.385291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] PATH_INFO: `/v3/projects/84c90381a5254271a782e50df047fbc5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.386482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c90381a5254271a782e50df047fbc5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:06.388573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:06.439989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:06.462092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c90381a5254271a782e50df047fbc5', 'request_id': 'req-f3a95785-d6af-4b41-a0bb-108f6f3267a1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.470145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c90381a5254271a782e50df047fbc5', 'request_id': 'req-f3a95785-d6af-4b41-a0bb-108f6f3267a1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.483414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c90381a5254271a782e50df047fbc5', 'request_id': 'req-f3a95785-d6af-4b41-a0bb-108f6f3267a1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.501019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] The token cache is being invalidate because project 84c90381a5254271a782e50df047fbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:09:06.501578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.503592 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3a95785-d6af-4b41-a0bb-108f6f3267a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:06.508849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1181/2350] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:09:06 2022] DELETE /identity/v3/projects/84c90381a5254271a782e50df047fbc5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:06.511486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817fce-d13d-426f-8044-d40f2cf71b41 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.511486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817fce-d13d-426f-8044-d40f2cf71b41 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.511772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817fce-d13d-426f-8044-d40f2cf71b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.534003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9f817fce-d13d-426f-8044-d40f2cf71b41 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:06.535311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f817fce-d13d-426f-8044-d40f2cf71b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:06.627713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1170/2351] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:06.629617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7be23-0eca-429f-ad76-97862df24645 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.630367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7be23-0eca-429f-ad76-97862df24645 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.631000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7be23-0eca-429f-ad76-97862df24645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.661658 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c0e7be23-0eca-429f-ad76-97862df24645 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:06.663839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c0e7be23-0eca-429f-ad76-97862df24645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:06.672848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1182/2352] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:09:06.677295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817fce-d13d-426f-8044-d40f2cf71b41 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:06.685507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:06.691252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817fce-d13d-426f-8044-d40f2cf71b41 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:06.699682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:06.701448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.701448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.701716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.702605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:09:06.702973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:06.717791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:06.728781 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1171/2353] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:09:06.734099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7be23-0eca-429f-ad76-97862df24645 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:06.744357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7be23-0eca-429f-ad76-97862df24645 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:06.750075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:06.750738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.751026 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.751300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.752100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:06.755752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:06.790526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1183/2354] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:06 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:06.795742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:06.809111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc251c-f93d-4a77-84b7-a5b98c9fffd1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:06.881698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:06.882427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.882683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.882887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.883582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:06.885928 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:06.922423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1172/2355] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:06 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:06.923754 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:06.937464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef172e2-4ccc-4294-a169-e29914046e71 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:06.945145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:06.946967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.947437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.947973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.948888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:06.952186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:06.969917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1184/2356] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:09:06.971874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:06.991619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02dc0e-ead8-4f0f-8e17-ab1f2a9f885e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:06.997187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7784a-01fb-486f-9536-ad348b8c0f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:06.997816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7784a-01fb-486f-9536-ad348b8c0f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:06.998143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7784a-01fb-486f-9536-ad348b8c0f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:06.998357 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7784a-01fb-486f-9536-ad348b8c0f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:06.999038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7784a-01fb-486f-9536-ad348b8c0f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:07.000711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7784a-01fb-486f-9536-ad348b8c0f46 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:07.012987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1173/2357] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:07.017590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:07.028123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03dc74-e09b-4d35-8b6f-4a78fba2b9bc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:07.033260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:07.033957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:07.034233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:07.034505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] PATH_INFO: `/v3/projects/09c810d1a3804937aface011909ace0e/users/38ea22821f134641844d1b954902a2e6/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:07.051715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c810d1a3804937aface011909ace0e, user_id=38ea22821f134641844d1b954902a2e6, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:07.054572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:07.071599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1185/2358] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:07 2022] PUT /identity/v3/projects/09c810d1a3804937aface011909ace0e/users/38ea22821f134641844d1b954902a2e6/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:07.082889 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946819-ec2e-49c7-8495-46d76b9bb271 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:07.083165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946819-ec2e-49c7-8495-46d76b9bb271 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:07.083421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946819-ec2e-49c7-8495-46d76b9bb271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:07.120655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-71946819-ec2e-49c7-8495-46d76b9bb271 None None] MFA Rules not processed for user `38ea22821f134641844d1b954902a2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:07.123372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-71946819-ec2e-49c7-8495-46d76b9bb271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:07.200570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1174/2359] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:07.212244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:07.214126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:07.314017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd21004-c35d-4184-b970-8eb270ba06cd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:07.321305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaa640-0fcf-47d2-aeda-1a25df1ade36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:07.322096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa640-0fcf-47d2-aeda-1a25df1ade36 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:07.322411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa640-0fcf-47d2-aeda-1a25df1ade36 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:07.322690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa640-0fcf-47d2-aeda-1a25df1ade36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:07.331655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaa640-0fcf-47d2-aeda-1a25df1ade36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:07.333626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaa640-0fcf-47d2-aeda-1a25df1ade36 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:07.347359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1186/2360] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:10.109831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946819-ec2e-49c7-8495-46d76b9bb271 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:10.176725 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946819-ec2e-49c7-8495-46d76b9bb271 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:10.181454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:10.182083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:10.182356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:10.182631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] PATH_INFO: `/v3/users/38ea22821f134641844d1b954902a2e6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:10.183803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ea22821f134641844d1b954902a2e6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:10.185759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:10.187564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:10.255065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ea22821f134641844d1b954902a2e6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.277391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ea22821f134641844d1b954902a2e6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.290404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ea22821f134641844d1b954902a2e6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.291583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ea22821f134641844d1b954902a2e6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.292562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ea22821f134641844d1b954902a2e6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.314074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1175/2361] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:09:10 2022] DELETE /identity/v3/users/38ea22821f134641844d1b954902a2e6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:10.319104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:10.319988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:10.320301 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:10.340562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:10.341990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:10.383869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:10.420040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1187/2362] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:10.431720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:10.434750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:10.505118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3781-6db2-400e-874e-f2c5d27a0b5c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:10.509623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678fd24-ed0e-4c23-9ab4-5be4f30c50d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:10.510263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678fd24-ed0e-4c23-9ab4-5be4f30c50d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:10.510603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678fd24-ed0e-4c23-9ab4-5be4f30c50d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:10.510862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678fd24-ed0e-4c23-9ab4-5be4f30c50d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:10.526586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678fd24-ed0e-4c23-9ab4-5be4f30c50d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:10.529313 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678fd24-ed0e-4c23-9ab4-5be4f30c50d1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:10.541419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1176/2363] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:10.820181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:10.821717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:10.835226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62529-444e-4a97-a11a-a5d9043a2c2a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:10.841573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:10.842213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:10.842516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:10.842755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] PATH_INFO: `/v3/projects/09c810d1a3804937aface011909ace0e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:10.844014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c810d1a3804937aface011909ace0e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:10.845995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:10.900852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c810d1a3804937aface011909ace0e', 'request_id': 'req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.906701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c810d1a3804937aface011909ace0e', 'request_id': 'req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.916769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c810d1a3804937aface011909ace0e', 'request_id': 'req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.932195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] The token cache is being invalidate because project 09c810d1a3804937aface011909ace0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:09:10.932535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.933798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a4bd2cd0-c68c-4160-a26d-22e0e3b3af0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:10.935596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1188/2364] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:09:10 2022] DELETE /identity/v3/projects/09c810d1a3804937aface011909ace0e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:10.940707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cfd0d-1bf3-426d-b9ce-57ac7e902972 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:10.941010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cfd0d-1bf3-426d-b9ce-57ac7e902972 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:10.941276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cfd0d-1bf3-426d-b9ce-57ac7e902972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:10.961647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-803cfd0d-1bf3-426d-b9ce-57ac7e902972 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:10.962847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-803cfd0d-1bf3-426d-b9ce-57ac7e902972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:11.025554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1177/2365] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:11.035030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100d47-544f-4148-8e79-3a02cb005c69 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.035264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100d47-544f-4148-8e79-3a02cb005c69 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.035563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100d47-544f-4148-8e79-3a02cb005c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.058452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5d100d47-544f-4148-8e79-3a02cb005c69 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:11.059850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5d100d47-544f-4148-8e79-3a02cb005c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:11.069345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1189/2366] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:11.074234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cfd0d-1bf3-426d-b9ce-57ac7e902972 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.086056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cfd0d-1bf3-426d-b9ce-57ac7e902972 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.094425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.095497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.095927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.096294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.096995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:09:11.097298 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.099598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.112925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1178/2367] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:09:11.117737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100d47-544f-4148-8e79-3a02cb005c69 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.127776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100d47-544f-4148-8e79-3a02cb005c69 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.132926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.133559 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.133837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.134109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.134752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.136731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.171365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1190/2368] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:11 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:11.177474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.190197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec799498-997b-4d13-b478-a6224dbee822 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.195220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:11.255650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.256264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.256538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.256824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.257472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.259398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.288025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1179/2369] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:11 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:11.294308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.307259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c11bf5-ddeb-4c96-a260-bfa1747943bf admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.315142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.316046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.316451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.316860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.317808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.320329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.331940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1191/2370] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:11.336359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.348200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baf426-e51f-4613-a333-1b60a31230cd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.355019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62d49-8c2e-463f-a923-e854c7fa723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.355682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62d49-8c2e-463f-a923-e854c7fa723e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.356031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62d49-8c2e-463f-a923-e854c7fa723e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.356303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62d49-8c2e-463f-a923-e854c7fa723e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.357082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62d49-8c2e-463f-a923-e854c7fa723e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.358857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62d49-8c2e-463f-a923-e854c7fa723e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.375853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1180/2371] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:11.378143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.388750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c0abc-8142-409c-aaf4-ce94033acaa2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.394063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.394748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.395053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.395321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] PATH_INFO: `/v3/projects/a402ad2350184559a81245f083a40d2a/users/9dee09c72d084bb1a798dcd4fe49afda/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.415448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a402ad2350184559a81245f083a40d2a, user_id=9dee09c72d084bb1a798dcd4fe49afda, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.418675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.437024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1192/2372] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:11 2022] PUT /identity/v3/projects/a402ad2350184559a81245f083a40d2a/users/9dee09c72d084bb1a798dcd4fe49afda/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:11.448098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1da4a-2d0b-4dc0-9f1b-70601d89d380 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.448365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1da4a-2d0b-4dc0-9f1b-70601d89d380 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.448633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1da4a-2d0b-4dc0-9f1b-70601d89d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.482134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-61c1da4a-2d0b-4dc0-9f1b-70601d89d380 None None] MFA Rules not processed for user `9dee09c72d084bb1a798dcd4fe49afda`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:11.483370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-61c1da4a-2d0b-4dc0-9f1b-70601d89d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:11.560172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1181/2373] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:11.564963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.632387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:11.637399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b6ac-1d17-4d9a-90eb-ef0c7e610996 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.647896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.648615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.648936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.649205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.649865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.652018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.683824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1193/2374] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:11 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:11.688692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1da4a-2d0b-4dc0-9f1b-70601d89d380 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.700511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1da4a-2d0b-4dc0-9f1b-70601d89d380 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.770443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.771053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.771328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.771599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.772222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.774265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.797792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1182/2375] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:11 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:11.802148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.819972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d4de1-ac26-4dd8-a920-d2710ede5b7c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.826992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.827966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.828367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.828774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.829797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.832479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.848646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1194/2376] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:11.854521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.865598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f47f0-9889-4108-b120-f909ff8abeff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.870996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.871664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.871937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.872237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] PATH_INFO: `/v3/projects/1ed0dca12108479394ecb653db5340af/users/7a5bf0e354d04c5f86d54cd94998d73a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.874744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:11.894368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed0dca12108479394ecb653db5340af, user_id=7a5bf0e354d04c5f86d54cd94998d73a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:11.898398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:11.916266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1183/2377] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:11 2022] PUT /identity/v3/projects/1ed0dca12108479394ecb653db5340af/users/7a5bf0e354d04c5f86d54cd94998d73a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:09:11.921628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:11.932469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc38e5e-0d4c-4507-8181-5c25a87649e6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:11.996571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a166eb-4473-411f-85b7-54b0d6fda66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:11.997472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a166eb-4473-411f-85b7-54b0d6fda66f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:11.997862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a166eb-4473-411f-85b7-54b0d6fda66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:11.998287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a166eb-4473-411f-85b7-54b0d6fda66f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:11.999543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a166eb-4473-411f-85b7-54b0d6fda66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:12.001548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a166eb-4473-411f-85b7-54b0d6fda66f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:12.017489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1195/2378] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:12.021086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:12.033287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb142a67-cf8d-4117-a7c6-ee05cb2898b8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:12.039705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:12.040387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:12.040657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:12.040956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] PATH_INFO: `/v3/projects/1ed0dca12108479394ecb653db5340af/users/7a5bf0e354d04c5f86d54cd94998d73a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:12.043408 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed0dca12108479394ecb653db5340af, user_id=7a5bf0e354d04c5f86d54cd94998d73a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:12.046382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:12.061352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1184/2379] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:12 2022] PUT /identity/v3/projects/1ed0dca12108479394ecb653db5340af/users/7a5bf0e354d04c5f86d54cd94998d73a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:12.073403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299db1-fa34-4e52-9dc9-cf449796433b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:12.073896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299db1-fa34-4e52-9dc9-cf449796433b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:12.074337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299db1-fa34-4e52-9dc9-cf449796433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:12.110039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2d299db1-fa34-4e52-9dc9-cf449796433b None None] MFA Rules not processed for user `7a5bf0e354d04c5f86d54cd94998d73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:12.111314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2d299db1-fa34-4e52-9dc9-cf449796433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:12.195236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1196/2380] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:12.203063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:12.205166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:12.286088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d085-106f-4f22-af49-6542b10d2e73 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:12.290270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:12.290901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:12.291162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:12.291548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:12.302407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:12.303907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:12.314852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1185/2381] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:12.412492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d299db1-fa34-4e52-9dc9-cf449796433b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:12.423363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d299db1-fa34-4e52-9dc9-cf449796433b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:12.427119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d88a64-3380-4c0a-9a31-5981f5817dde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:12.427824 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d88a64-3380-4c0a-9a31-5981f5817dde service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:12.428107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d88a64-3380-4c0a-9a31-5981f5817dde service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:12.428372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d88a64-3380-4c0a-9a31-5981f5817dde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:12.487823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:12.502814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d88a64-3380-4c0a-9a31-5981f5817dde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:12.505086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d88a64-3380-4c0a-9a31-5981f5817dde service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:12.518055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1197/2382] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:22.310339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=38,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:22.513612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:42.865671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:42.945023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205a75-5af1-4a5a-824c-c7b6e0452fb4 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:42.952655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:42.953667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:42.954044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:42.954444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] PATH_INFO: `/v3/users/9dee09c72d084bb1a798dcd4fe49afda` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:42.956100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dee09c72d084bb1a798dcd4fe49afda)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:42.958134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:43.020813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dee09c72d084bb1a798dcd4fe49afda'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.034557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dee09c72d084bb1a798dcd4fe49afda'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.042139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dee09c72d084bb1a798dcd4fe49afda'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.042902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dee09c72d084bb1a798dcd4fe49afda'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.043901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dee09c72d084bb1a798dcd4fe49afda'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.063511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1186/2383] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:09:42 2022] DELETE /identity/v3/users/9dee09c72d084bb1a798dcd4fe49afda => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:43.068473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:43.069040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:43.069040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:43.089003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:43.090215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:43.159549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1198/2384] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:43.171154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:43.172655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:43.236467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4fc1d-03d6-44e8-877a-94526eea4559 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:43.240572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:43.241205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:43.241473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:43.241736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:43.251478 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:43.252942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:43.262751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1187/2385] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:09:43.557931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:43.559664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:43.574021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e45b6-a469-4aca-9007-91f0876dd6e8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:43.586041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:43.586702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:43.586980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:43.587255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] PATH_INFO: `/v3/projects/a402ad2350184559a81245f083a40d2a` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:43.589027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a402ad2350184559a81245f083a40d2a)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:43.601584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:43.654642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a402ad2350184559a81245f083a40d2a', 'request_id': 'req-65bd2615-3373-47ff-ad49-c267fd7a25df'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.661000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a402ad2350184559a81245f083a40d2a', 'request_id': 'req-65bd2615-3373-47ff-ad49-c267fd7a25df'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.669146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a402ad2350184559a81245f083a40d2a', 'request_id': 'req-65bd2615-3373-47ff-ad49-c267fd7a25df'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.681588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] The token cache is being invalidate because project a402ad2350184559a81245f083a40d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:09:43.681878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.682590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.684204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1199/2386] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:09:43 2022] DELETE /identity/v3/projects/a402ad2350184559a81245f083a40d2a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:43.688465 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:43.699028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0551-a8c4-48e2-9036-be2ae9e20c3f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:43.720019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:43.775933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:43.776562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:43.776866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:43.777142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] PATH_INFO: `/v3/users/7a5bf0e354d04c5f86d54cd94998d73a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:43.778980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5bf0e354d04c5f86d54cd94998d73a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:43.780924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:43.830300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5bf0e354d04c5f86d54cd94998d73a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.851678 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5bf0e354d04c5f86d54cd94998d73a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.860670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5bf0e354d04c5f86d54cd94998d73a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.861663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5bf0e354d04c5f86d54cd94998d73a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.862363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-47c8df81-5612-4487-9872-b05bf4b0de19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5bf0e354d04c5f86d54cd94998d73a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:43.876875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1188/2387] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:09:43 2022] DELETE /identity/v3/users/7a5bf0e354d04c5f86d54cd94998d73a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:44.205960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:44.207499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:44.226446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2615-3373-47ff-ad49-c267fd7a25df admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:44.301562 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:44.302142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.302464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.302908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] PATH_INFO: `/v3/projects/1ed0dca12108479394ecb653db5340af` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.303972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed0dca12108479394ecb653db5340af)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:44.306768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:44.352759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:44.375842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed0dca12108479394ecb653db5340af', 'request_id': 'req-c073fb64-5647-4086-a88d-8968b118cfed'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:44.383506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed0dca12108479394ecb653db5340af', 'request_id': 'req-c073fb64-5647-4086-a88d-8968b118cfed'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:44.394946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed0dca12108479394ecb653db5340af', 'request_id': 'req-c073fb64-5647-4086-a88d-8968b118cfed'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:44.408017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] The token cache is being invalidate because project 1ed0dca12108479394ecb653db5340af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:09:44.408441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:44.409115 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c073fb64-5647-4086-a88d-8968b118cfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:44.410818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1200/2388] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:09:44 2022] DELETE /identity/v3/projects/1ed0dca12108479394ecb653db5340af => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:44.418757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81cc26-d5f2-4910-8820-1c0ef5769f9e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.419084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81cc26-d5f2-4910-8820-1c0ef5769f9e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.419444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81cc26-d5f2-4910-8820-1c0ef5769f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.448495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4e81cc26-d5f2-4910-8820-1c0ef5769f9e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:44.450326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4e81cc26-d5f2-4910-8820-1c0ef5769f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:44.525831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1189/2389] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:09:44.536063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb9abe-6ae0-4b91-9e77-6b11eff56b1e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.536347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb9abe-6ae0-4b91-9e77-6b11eff56b1e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.536622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb9abe-6ae0-4b91-9e77-6b11eff56b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.561656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c8bb9abe-6ae0-4b91-9e77-6b11eff56b1e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:44.562796 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c8bb9abe-6ae0-4b91-9e77-6b11eff56b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:44.571865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1201/2390] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:44.577008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81cc26-d5f2-4910-8820-1c0ef5769f9e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:44.588897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81cc26-d5f2-4910-8820-1c0ef5769f9e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:44.595104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:44.596377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.597035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.597716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.598315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:09:44.598793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:44.602416 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:44.626341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1190/2391] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:09:44.631488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb9abe-6ae0-4b91-9e77-6b11eff56b1e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:44.642238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb9abe-6ae0-4b91-9e77-6b11eff56b1e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:44.648351 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:44.648989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.655390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.655390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.655390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:44.655390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:44.687554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1202/2392] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:44 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:44.694169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:44.706497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e8543-0498-4bcd-ab54-0692d041f55b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:44.746815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:44.786792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:44.787421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.787687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.787956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.788615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:44.790617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:44.818925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1191/2393] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:44 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:44.822169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:44.834417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fead0-b1b0-47e6-b6a3-93d497902be0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:44.841670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:44.842296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.842568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.842831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.843479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:44.845379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:44.860111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1203/2394] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:44.865268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:44.877671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10f8fc-d415-4e93-87be-dd0028cb1962 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:44.883596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83792f7c-9206-4180-b4b8-c91af15366a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:44.884207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792f7c-9206-4180-b4b8-c91af15366a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.884474 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792f7c-9206-4180-b4b8-c91af15366a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.884753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792f7c-9206-4180-b4b8-c91af15366a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.885432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83792f7c-9206-4180-b4b8-c91af15366a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:44.887054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83792f7c-9206-4180-b4b8-c91af15366a9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:44.899419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1192/2395] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:44.904950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:44.918602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c534-c0b3-43ec-b1b4-a0942a8bc322 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:44.924958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:44.925719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.926173 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.926610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] PATH_INFO: `/v3/projects/2d0c240d78c74467aaffc3c5b541da23/users/95cda1238a7f4b45b26e15d24685767c/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:44.944265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0c240d78c74467aaffc3c5b541da23, user_id=95cda1238a7f4b45b26e15d24685767c, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:44.946946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:44.967666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1204/2396] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:44 2022] PUT /identity/v3/projects/2d0c240d78c74467aaffc3c5b541da23/users/95cda1238a7f4b45b26e15d24685767c/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:44.982179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517b40-208a-4ddb-be89-56599630cccd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:44.982446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517b40-208a-4ddb-be89-56599630cccd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:44.982740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517b40-208a-4ddb-be89-56599630cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.020656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9b517b40-208a-4ddb-be89-56599630cccd None None] MFA Rules not processed for user `95cda1238a7f4b45b26e15d24685767c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:45.021908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b517b40-208a-4ddb-be89-56599630cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:45.104406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1193/2397] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:45.109848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:45.209995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348ca70-0f48-4bbc-a061-f155eb2ac547 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:45.221867 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:45.223217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.223662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.224102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.225226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:45.228237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:45.271965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1205/2398] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:45 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:09:45.277261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b517b40-208a-4ddb-be89-56599630cccd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:45.296398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b517b40-208a-4ddb-be89-56599630cccd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:45.376525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:45.376900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.377171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.377440 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.378299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:45.380379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:45.404755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1194/2399] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:45 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:45.409152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:45.420054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f0d2f-4506-415c-8d3f-6d88d674a56b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:45.429104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:45.429741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.430021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.430290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.430941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:45.432549 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:45.445188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1206/2400] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:45.449698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:45.460944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46047825-5d48-405b-bd65-25d3d6964f3a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:45.466409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:45.467071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.467346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.467616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] PATH_INFO: `/v3/projects/b44f4c25345d4f31ace2ff393c2887c8/users/d899bd6cc6734a4e8d98bbc6cc3a96e5/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.485198 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44f4c25345d4f31ace2ff393c2887c8, user_id=d899bd6cc6734a4e8d98bbc6cc3a96e5, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:45.488020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:45.510537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1195/2401] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:45 2022] PUT /identity/v3/projects/b44f4c25345d4f31ace2ff393c2887c8/users/d899bd6cc6734a4e8d98bbc6cc3a96e5/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:45.515476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:45.529878 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d20b8-358f-4a66-9a6a-8a2db18e7152 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:45.551656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:45.598597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227939-a1fe-4e8f-84a2-82476fcba4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:45.599226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227939-a1fe-4e8f-84a2-82476fcba4ca admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.599504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227939-a1fe-4e8f-84a2-82476fcba4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.599775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227939-a1fe-4e8f-84a2-82476fcba4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.600424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227939-a1fe-4e8f-84a2-82476fcba4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:45.602061 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227939-a1fe-4e8f-84a2-82476fcba4ca admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:45.612903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1207/2402] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:45.617388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:45.623000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:45.629589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1f627-6f0f-4d14-8360-426f044876e0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:45.637909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:45.639056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.639577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.640069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] PATH_INFO: `/v3/projects/b44f4c25345d4f31ace2ff393c2887c8/users/d899bd6cc6734a4e8d98bbc6cc3a96e5/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.643575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44f4c25345d4f31ace2ff393c2887c8, user_id=d899bd6cc6734a4e8d98bbc6cc3a96e5, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:45.649198 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:45.668521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1196/2403] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:45 2022] PUT /identity/v3/projects/b44f4c25345d4f31ace2ff393c2887c8/users/d899bd6cc6734a4e8d98bbc6cc3a96e5/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:45.685821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098441f-d639-451e-b39c-0e139a9c84df None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.686375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098441f-d639-451e-b39c-0e139a9c84df None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.686671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098441f-d639-451e-b39c-0e139a9c84df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.720458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3098441f-d639-451e-b39c-0e139a9c84df None None] MFA Rules not processed for user `d899bd6cc6734a4e8d98bbc6cc3a96e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:45.721866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3098441f-d639-451e-b39c-0e139a9c84df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:45.793268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1208/2404] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:45.804514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:45.806622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:45.867571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739211-9f88-4588-9330-c05af429ef0c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:45.871498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd2bed-f2d9-4e20-8a68-980a72c4e80a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:45.872130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd2bed-f2d9-4e20-8a68-980a72c4e80a service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:45.872401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd2bed-f2d9-4e20-8a68-980a72c4e80a service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:45.872643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd2bed-f2d9-4e20-8a68-980a72c4e80a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:45.882212 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd2bed-f2d9-4e20-8a68-980a72c4e80a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:45.883603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd2bed-f2d9-4e20-8a68-980a72c4e80a service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:45.893272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1197/2405] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:47.451273 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098441f-d639-451e-b39c-0e139a9c84df None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:47.522175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098441f-d639-451e-b39c-0e139a9c84df None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:47.527102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:47.527750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:47.528024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:47.528295 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] PATH_INFO: `/v3/users/95cda1238a7f4b45b26e15d24685767c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:47.529524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cda1238a7f4b45b26e15d24685767c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:47.531423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:47.595851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cda1238a7f4b45b26e15d24685767c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:47.597899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:47.606109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cda1238a7f4b45b26e15d24685767c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:47.622300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cda1238a7f4b45b26e15d24685767c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:47.623098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cda1238a7f4b45b26e15d24685767c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:47.640523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cda1238a7f4b45b26e15d24685767c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:47.647145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1209/2406] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:09:47 2022] DELETE /identity/v3/users/95cda1238a7f4b45b26e15d24685767c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:47.651927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:47.652436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:47.652436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:47.672224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:47.673511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:47.749110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1198/2407] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:47.759494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:47.761048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:47.827383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f806b-9da8-41db-963d-19071a66492b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:47.831492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:47.832104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:47.832376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:47.832647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:47.842452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:47.843880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:47.856162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1210/2408] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:48.150226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:48.151801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:48.166055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d0fe4-d411-4c11-914b-8e0c41d495ac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:48.171788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:48.172510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:48.172946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:48.173219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] PATH_INFO: `/v3/projects/2d0c240d78c74467aaffc3c5b541da23` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:48.175031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0c240d78c74467aaffc3c5b541da23)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:48.177082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:48.231553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0c240d78c74467aaffc3c5b541da23', 'request_id': 'req-7b9881d9-9cdd-41c7-aece-eaadaef9886e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.238902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0c240d78c74467aaffc3c5b541da23', 'request_id': 'req-7b9881d9-9cdd-41c7-aece-eaadaef9886e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.245813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0c240d78c74467aaffc3c5b541da23', 'request_id': 'req-7b9881d9-9cdd-41c7-aece-eaadaef9886e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.260286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] The token cache is being invalidate because project 2d0c240d78c74467aaffc3c5b541da23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:09:48.261004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.261164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.262687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1199/2409] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:09:48 2022] DELETE /identity/v3/projects/2d0c240d78c74467aaffc3c5b541da23 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:48.266892 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:48.276949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548e10-36b2-4119-8f5d-6a153d631282 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:48.339239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:48.339886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:48.340159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:48.340425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] PATH_INFO: `/v3/users/d899bd6cc6734a4e8d98bbc6cc3a96e5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:48.341603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d899bd6cc6734a4e8d98bbc6cc3a96e5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:48.343598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:48.395455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd899bd6cc6734a4e8d98bbc6cc3a96e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.403603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd899bd6cc6734a4e8d98bbc6cc3a96e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.414062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd899bd6cc6734a4e8d98bbc6cc3a96e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.414766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd899bd6cc6734a4e8d98bbc6cc3a96e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.420691 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:48.429842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9ee5d647-78d7-4f3f-94ea-b9bf738e627e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd899bd6cc6734a4e8d98bbc6cc3a96e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.436526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1211/2410] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:09:48 2022] DELETE /identity/v3/users/d899bd6cc6734a4e8d98bbc6cc3a96e5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:48.736307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:48.738034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:48.777684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9881d9-9cdd-41c7-aece-eaadaef9886e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:48.787379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:48.849037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:48.849717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:48.849972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:48.850324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] PATH_INFO: `/v3/projects/b44f4c25345d4f31ace2ff393c2887c8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:48.851881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44f4c25345d4f31ace2ff393c2887c8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:48.854108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:48.914636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44f4c25345d4f31ace2ff393c2887c8', 'request_id': 'req-26e302e9-92b5-417b-89d2-8b890b4eab1b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.921901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44f4c25345d4f31ace2ff393c2887c8', 'request_id': 'req-26e302e9-92b5-417b-89d2-8b890b4eab1b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.929939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44f4c25345d4f31ace2ff393c2887c8', 'request_id': 'req-26e302e9-92b5-417b-89d2-8b890b4eab1b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.944691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] The token cache is being invalidate because project b44f4c25345d4f31ace2ff393c2887c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:09:48.945110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.945758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-26e302e9-92b5-417b-89d2-8b890b4eab1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:09:48.947579 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1200/2411] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:09:48 2022] DELETE /identity/v3/projects/b44f4c25345d4f31ace2ff393c2887c8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:48.952341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75899e-dc08-4787-b176-b9ad6168997b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:48.953177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75899e-dc08-4787-b176-b9ad6168997b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:48.953177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75899e-dc08-4787-b176-b9ad6168997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:48.976973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-db75899e-dc08-4787-b176-b9ad6168997b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:48.978207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-db75899e-dc08-4787-b176-b9ad6168997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:49.046737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1212/2412] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:49.055550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9546-873a-4a4c-beca-07ada07159d6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.055834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9546-873a-4a4c-beca-07ada07159d6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.056104 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9546-873a-4a4c-beca-07ada07159d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.077078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-eb3a9546-873a-4a4c-beca-07ada07159d6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:49.078307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-eb3a9546-873a-4a4c-beca-07ada07159d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:49.087495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1201/2413] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:49.092105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75899e-dc08-4787-b176-b9ad6168997b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.102740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75899e-dc08-4787-b176-b9ad6168997b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.107467 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.108096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.108419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.108693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.109411 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:09:49.109709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.111589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.123097 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1213/2414] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:09:49.128203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9546-873a-4a4c-beca-07ada07159d6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.137561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9546-873a-4a4c-beca-07ada07159d6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.142841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.143446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.143722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.143994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.144646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.146601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.181091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1202/2415] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:49.187594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.199287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9dacf-59a6-4010-bcda-307b2d3ceb9f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.267975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.268588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.268856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.269154 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.269777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.271673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.297751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1214/2416] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:49 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:49.299141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.309330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332be5-bf93-412d-b6bc-427190647a9b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.314144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.314785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.315161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.315437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.316091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.317710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.327523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1203/2417] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:49.331943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.342670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8b6f-3a12-45b0-be4c-b5cf87fd9110 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.348712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c5f7-a94e-4d3d-b10b-7f4282f14c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.349355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c5f7-a94e-4d3d-b10b-7f4282f14c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.349630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c5f7-a94e-4d3d-b10b-7f4282f14c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.349885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c5f7-a94e-4d3d-b10b-7f4282f14c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.350561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c5f7-a94e-4d3d-b10b-7f4282f14c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.352146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c5f7-a94e-4d3d-b10b-7f4282f14c1e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.363224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1215/2418] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:49.369359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.379997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28834a4f-686d-4ca9-93e9-69a788f5645a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.385879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.386527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.386801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.387065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] PATH_INFO: `/v3/projects/44f2346cf544447f8259a2e5e4677706/users/97daa967aa8c4806acf4f35553b197b3/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.402552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f2346cf544447f8259a2e5e4677706, user_id=97daa967aa8c4806acf4f35553b197b3, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.405241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.422142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1204/2419] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:49 2022] PUT /identity/v3/projects/44f2346cf544447f8259a2e5e4677706/users/97daa967aa8c4806acf4f35553b197b3/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:49.441092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bdd78-7952-46b6-b1a6-6f27f0578fa9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.441322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bdd78-7952-46b6-b1a6-6f27f0578fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.441738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bdd78-7952-46b6-b1a6-6f27f0578fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.471530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e25bdd78-7952-46b6-b1a6-6f27f0578fa9 None None] MFA Rules not processed for user `97daa967aa8c4806acf4f35553b197b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:49.473113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e25bdd78-7952-46b6-b1a6-6f27f0578fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:49.515579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:49.540728 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1216/2420] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:49.545343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.597260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:49.617185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601dc5e-2283-42d6-a608-30cc8edb5fd7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.622804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.623421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.623696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.623959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.624592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.626610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.655713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1205/2421] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:09:49 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:09:49.660022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bdd78-7952-46b6-b1a6-6f27f0578fa9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.670885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bdd78-7952-46b6-b1a6-6f27f0578fa9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.731276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.731904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.732178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.732428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.733102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.735039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.761131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1217/2422] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:09:49 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:09:49.766807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.778259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70812d7-f6a8-4913-8fb1-3280cb80202b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.783826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.785075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.785354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.785617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.786255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.787844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.799307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1206/2423] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:49.811462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.827034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c43fc-5b43-4012-b0aa-12741c805b2e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.834134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.834794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.835073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.835343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] PATH_INFO: `/v3/projects/f489141a26cb4bb7b2d2685956a65585/users/55a6d9d130594eba93b382cae9edf771/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.851225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f489141a26cb4bb7b2d2685956a65585, user_id=55a6d9d130594eba93b382cae9edf771, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.853893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.868677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1218/2424] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:49 2022] PUT /identity/v3/projects/f489141a26cb4bb7b2d2685956a65585/users/55a6d9d130594eba93b382cae9edf771/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:09:49.872870 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.882747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452772-0ea2-410a-ba43-3a43d8738176 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.946777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83220004-73d6-4efe-a720-439a1bc9dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.947662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220004-73d6-4efe-a720-439a1bc9dbaa admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.947942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220004-73d6-4efe-a720-439a1bc9dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.948279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220004-73d6-4efe-a720-439a1bc9dbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.948987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83220004-73d6-4efe-a720-439a1bc9dbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.950545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83220004-73d6-4efe-a720-439a1bc9dbaa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:49.961441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1207/2425] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:09:49.966635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:49.979106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091fb85-26bb-4c97-84de-4f17095cf389 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:49.984437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:49.985161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:49.985442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:49.985714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] PATH_INFO: `/v3/projects/f489141a26cb4bb7b2d2685956a65585/users/55a6d9d130594eba93b382cae9edf771/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:49.989135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f489141a26cb4bb7b2d2685956a65585, user_id=55a6d9d130594eba93b382cae9edf771, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:49.990561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:50.003511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1219/2426] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:09:49 2022] PUT /identity/v3/projects/f489141a26cb4bb7b2d2685956a65585/users/55a6d9d130594eba93b382cae9edf771/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:09:50.014003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58ddb-9372-4fb8-af94-2973f5f956d6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:50.014278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58ddb-9372-4fb8-af94-2973f5f956d6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:50.014553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58ddb-9372-4fb8-af94-2973f5f956d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:50.045512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cec58ddb-9372-4fb8-af94-2973f5f956d6 None None] MFA Rules not processed for user `55a6d9d130594eba93b382cae9edf771`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:50.046874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cec58ddb-9372-4fb8-af94-2973f5f956d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:50.124086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1208/2427] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:09:50.135528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:50.137727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:50.196163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8ff9-dbee-4c62-b862-034b79ef125f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:50.199921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287040-98c2-489f-ab55-4c66364e1a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:50.200535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287040-98c2-489f-ab55-4c66364e1a4c service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:50.200834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287040-98c2-489f-ab55-4c66364e1a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:50.201128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287040-98c2-489f-ab55-4c66364e1a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:50.271258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:50.274144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287040-98c2-489f-ab55-4c66364e1a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:50.276084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287040-98c2-489f-ab55-4c66364e1a4c service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:50.286433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1220/2428] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:52.951427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58ddb-9372-4fb8-af94-2973f5f956d6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:09:52.962329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58ddb-9372-4fb8-af94-2973f5f956d6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:09:52.965912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:09:52.966527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:52.966800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:52.967067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:52.977633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:09:52.979061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:09:52.989822 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1209/2429] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:09:54.776263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2303b-afab-4f74-81d6-1e44dc2acb8a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:09:54.776794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2303b-afab-4f74-81d6-1e44dc2acb8a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:09:54.776794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2303b-afab-4f74-81d6-1e44dc2acb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:09:54.801538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-06b2303b-afab-4f74-81d6-1e44dc2acb8a None None] MFA Rules not processed for user `ec329f81679e4ffa83174d621b4440d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:09:54.802772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-06b2303b-afab-4f74-81d6-1e44dc2acb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:09:54.879513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1221/2430] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:02.984577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:04.867348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=30 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:05.845051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:05.928218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2c40-fbd0-4508-b6c5-8e8d915c9594 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:05.935045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:05.935710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:05.935988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:05.936262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] PATH_INFO: `/v3/users/97daa967aa8c4806acf4f35553b197b3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:05.938433 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=97daa967aa8c4806acf4f35553b197b3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:05.940396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:06.009545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97daa967aa8c4806acf4f35553b197b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.036100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97daa967aa8c4806acf4f35553b197b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.047894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97daa967aa8c4806acf4f35553b197b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.048860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97daa967aa8c4806acf4f35553b197b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.049664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97daa967aa8c4806acf4f35553b197b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.070200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1210/2431] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:10:05 2022] DELETE /identity/v3/users/97daa967aa8c4806acf4f35553b197b3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:06.084970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:06.085483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:06.085846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:06.107599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:06.108917 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:06.174297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1222/2432] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:06.184984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:06.186514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:06.281759 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc75b8-ef00-4db1-bf95-f14a52a68dfb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:06.287890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:06.289015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:06.289516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:06.290000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:06.303336 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:06.305002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:06.317116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1211/2433] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:10:06.635038 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:06.636781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:06.652395 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757256b-5e92-4740-b24b-836385cb84e2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:06.656466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:06.657449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:06.658313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:06.658313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] PATH_INFO: `/v3/projects/44f2346cf544447f8259a2e5e4677706` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:06.659425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f2346cf544447f8259a2e5e4677706)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:06.661401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:06.713532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f2346cf544447f8259a2e5e4677706', 'request_id': 'req-6d5e2fdb-09db-4295-90e3-afde8c282c24'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.719490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f2346cf544447f8259a2e5e4677706', 'request_id': 'req-6d5e2fdb-09db-4295-90e3-afde8c282c24'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.740697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f2346cf544447f8259a2e5e4677706', 'request_id': 'req-6d5e2fdb-09db-4295-90e3-afde8c282c24'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.759989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] The token cache is being invalidate because project 44f2346cf544447f8259a2e5e4677706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:10:06.759989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.759989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.760919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1223/2434] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:10:06 2022] DELETE /identity/v3/projects/44f2346cf544447f8259a2e5e4677706 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:06.765342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:06.779125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1405ca-90c1-4939-a6b3-6746e9a5189b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:06.798855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:06.842193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:06.842854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:06.843129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:06.843394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] PATH_INFO: `/v3/users/55a6d9d130594eba93b382cae9edf771` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:06.844589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a6d9d130594eba93b382cae9edf771)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:06.847289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:06.899183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a6d9d130594eba93b382cae9edf771'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.911420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a6d9d130594eba93b382cae9edf771'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.919656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a6d9d130594eba93b382cae9edf771'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.920353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a6d9d130594eba93b382cae9edf771'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.921017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9f3d8d4-f709-45eb-b179-7476d0c39b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a6d9d130594eba93b382cae9edf771'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:06.939037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1212/2435] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:10:06 2022] DELETE /identity/v3/users/55a6d9d130594eba93b382cae9edf771 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:07.251364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:07.252901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:07.278318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e2fdb-09db-4295-90e3-afde8c282c24 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:07.343350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:07.344023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.344327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.344570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] PATH_INFO: `/v3/projects/f489141a26cb4bb7b2d2685956a65585` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.345843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f489141a26cb4bb7b2d2685956a65585)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:07.348134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:07.393204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:07.418671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f489141a26cb4bb7b2d2685956a65585', 'request_id': 'req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:07.425032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f489141a26cb4bb7b2d2685956a65585', 'request_id': 'req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:07.433466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f489141a26cb4bb7b2d2685956a65585', 'request_id': 'req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:07.446046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] The token cache is being invalidate because project f489141a26cb4bb7b2d2685956a65585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:10:07.446464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:07.447219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9eb4ac43-194d-4b9f-a032-2e5a1fae82b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:07.449022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1224/2436] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:10:07 2022] DELETE /identity/v3/projects/f489141a26cb4bb7b2d2685956a65585 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:07.453875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fb0b-d28a-4cc0-abef-6ad6b1e65faa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.454140 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fb0b-d28a-4cc0-abef-6ad6b1e65faa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.454464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fb0b-d28a-4cc0-abef-6ad6b1e65faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.477529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2794fb0b-d28a-4cc0-abef-6ad6b1e65faa None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:07.478931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2794fb0b-d28a-4cc0-abef-6ad6b1e65faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:07.541882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1213/2437] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:07.551657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513573f-082b-431e-bbfb-c92e6a1c879e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.551915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513573f-082b-431e-bbfb-c92e6a1c879e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.552258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513573f-082b-431e-bbfb-c92e6a1c879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.572690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3513573f-082b-431e-bbfb-c92e6a1c879e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:07.574022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3513573f-082b-431e-bbfb-c92e6a1c879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:07.591006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1225/2438] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:10:07.595604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794fb0b-d28a-4cc0-abef-6ad6b1e65faa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:07.606063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794fb0b-d28a-4cc0-abef-6ad6b1e65faa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:07.611578 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:07.612199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.612469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.613325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.613471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:10:07.613710 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:07.615363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:07.632061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1214/2439] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:10:07.636765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513573f-082b-431e-bbfb-c92e6a1c879e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:07.647368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513573f-082b-431e-bbfb-c92e6a1c879e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:07.654352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:07.654901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.655233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.655438 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.656084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:07.658148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:07.690674 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1226/2440] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:10:07 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:07.695895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:07.707294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88a1a6-6fe2-49f0-bc28-cacc33537edb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:07.736786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:07.778289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:07.778955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.779234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.779524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.780153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:07.782138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:07.809908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1215/2441] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:10:07 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:07.814228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:07.826427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba0d93-11c8-49cd-9b68-76bceab3b157 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:07.831944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:07.832588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.832895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.833169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.833804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:07.835449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:07.847837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1227/2442] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:07.852191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:07.870162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb409467-2b81-4b51-9945-c999184f7620 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:07.876213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baab18-7041-408f-b79d-ac26ec5df376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:07.876869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baab18-7041-408f-b79d-ac26ec5df376 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.877279 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baab18-7041-408f-b79d-ac26ec5df376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.877406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baab18-7041-408f-b79d-ac26ec5df376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.878053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baab18-7041-408f-b79d-ac26ec5df376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:07.879673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baab18-7041-408f-b79d-ac26ec5df376 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:07.891488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1216/2443] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:07.896172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:07.907445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cab32c-f256-4496-bc1d-26ac08c1541c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:07.912501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:07.913215 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.913512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.913816 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] PATH_INFO: `/v3/projects/22e5e0774ef747b2b4f2a1a163c26d3f/users/a1e2fa4fe31841499e2ddacb47fe2873/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:07.930219 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e5e0774ef747b2b4f2a1a163c26d3f, user_id=a1e2fa4fe31841499e2ddacb47fe2873, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:07.933046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:07.956927 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1228/2444] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:07 2022] PUT /identity/v3/projects/22e5e0774ef747b2b4f2a1a163c26d3f/users/a1e2fa4fe31841499e2ddacb47fe2873/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:07.961997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ecfa1-f59a-43fb-9f12-e301ca5fd735 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:07.962254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ecfa1-f59a-43fb-9f12-e301ca5fd735 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:07.962254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ecfa1-f59a-43fb-9f12-e301ca5fd735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.006709 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5d4ecfa1-f59a-43fb-9f12-e301ca5fd735 None None] MFA Rules not processed for user `a1e2fa4fe31841499e2ddacb47fe2873`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:08.009510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5d4ecfa1-f59a-43fb-9f12-e301ca5fd735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:08.089281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1217/2445] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:08.094972 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.174228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a1fe-2c2e-4a12-921d-2dd90e20da8d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.180330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.181112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.181458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.181668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.182374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.184795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.223788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1229/2446] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:10:08 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:08.227829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ecfa1-f59a-43fb-9f12-e301ca5fd735 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.240544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ecfa1-f59a-43fb-9f12-e301ca5fd735 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.316554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.317991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.317991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.317991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.318756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.320782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.348029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1218/2447] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:10:08 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:10:08.352389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.367465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f8dd-c5e1-48e4-9ce2-6ceb046fd081 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.379267 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.380033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.380323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.380554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.381460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.383258 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.398158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1230/2448] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:08.403022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.416311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b52b-c080-4295-aaf7-48782fc087ba admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.428688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5379f-fc88-4263-b15a-010e1eec11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.429670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5379f-fc88-4263-b15a-010e1eec11ee admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.430011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5379f-fc88-4263-b15a-010e1eec11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.430316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5379f-fc88-4263-b15a-010e1eec11ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.431000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5379f-fc88-4263-b15a-010e1eec11ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.432656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5379f-fc88-4263-b15a-010e1eec11ee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.445713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1219/2449] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:10:08.450450 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.465433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fdd81-6df3-4efa-8251-48ae0e0e40a2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.473101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.474374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.474906 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.475426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] PATH_INFO: `/v3/projects/60b1e88515c6410eae9615a67b561155/users/a248104201ad4db1bf857e0205a61659/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.501377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b1e88515c6410eae9615a67b561155, user_id=a248104201ad4db1bf857e0205a61659, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.504139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.516226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:08.522569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1231/2450] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:08 2022] PUT /identity/v3/projects/60b1e88515c6410eae9615a67b561155/users/a248104201ad4db1bf857e0205a61659/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:08.533436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018978f-346a-40bf-a9c4-f60deff0e144 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.533808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018978f-346a-40bf-a9c4-f60deff0e144 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.534145 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018978f-346a-40bf-a9c4-f60deff0e144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.566982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9018978f-346a-40bf-a9c4-f60deff0e144 None None] MFA Rules not processed for user `a248104201ad4db1bf857e0205a61659`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:08.568213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9018978f-346a-40bf-a9c4-f60deff0e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:08.572377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:08.642187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1220/2451] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:10:08.646886 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.717737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabe6c7-5a26-4a85-b3ea-d7189a5b1e29 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.723328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.724049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.724445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.724748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.725505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.727488 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.766092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1232/2452] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:10:08 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:08.767311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018978f-346a-40bf-a9c4-f60deff0e144 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.779232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018978f-346a-40bf-a9c4-f60deff0e144 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.854896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.856021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.856129 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.856379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.857078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.859089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.893058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1221/2453] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:10:08 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:08.898309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.911445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb902b8b-fd7b-4e05-97c9-455749ad15c3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.917260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.919603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.919881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.920153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.921710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.922514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:08.936855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1233/2454] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:08.942056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:08.958297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e27f5b-2600-49e9-ae23-1ac3acb22d4d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:08.963702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:08.964475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:08.964836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:08.965446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] PATH_INFO: `/v3/projects/9d337763532c4844935cecc7e49712f6/users/0c79402eab4f41f299fa40ff7efa1e62/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:08.989510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d337763532c4844935cecc7e49712f6, user_id=0c79402eab4f41f299fa40ff7efa1e62, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:08.995577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:09.022589 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1222/2455] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:08 2022] PUT /identity/v3/projects/9d337763532c4844935cecc7e49712f6/users/0c79402eab4f41f299fa40ff7efa1e62/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:09.026980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:09.041670 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f231b-e0d9-4aa8-8a4c-355ad05aacb0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:09.133382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d91cd-df2a-4cfc-b52a-b6df54176510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:09.134329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d91cd-df2a-4cfc-b52a-b6df54176510 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:09.134761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d91cd-df2a-4cfc-b52a-b6df54176510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:09.135252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d91cd-df2a-4cfc-b52a-b6df54176510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:09.135919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d91cd-df2a-4cfc-b52a-b6df54176510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:09.137839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d91cd-df2a-4cfc-b52a-b6df54176510 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:09.153765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1234/2456] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:09.154448 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:09.167089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d1b50-2881-425d-8df6-fb8c62ee4f75 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:09.173706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:09.174808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:09.175157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:09.175489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] PATH_INFO: `/v3/projects/9d337763532c4844935cecc7e49712f6/users/0c79402eab4f41f299fa40ff7efa1e62/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:09.177640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d337763532c4844935cecc7e49712f6, user_id=0c79402eab4f41f299fa40ff7efa1e62, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:09.180580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:09.195134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1223/2457] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:09 2022] PUT /identity/v3/projects/9d337763532c4844935cecc7e49712f6/users/0c79402eab4f41f299fa40ff7efa1e62/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:10:09.269190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:09.269473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:09.269744 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:09.305890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] MFA Rules not processed for user `0c79402eab4f41f299fa40ff7efa1e62`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:09.307156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:09.394294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:09.417781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1235/2458] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:09.430146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:09.431992 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:09.502794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddef55-99ea-4f56-8d73-74df156b7f70 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:09.506320 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:09.506924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:09.507197 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:09.507461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:09.518892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:09.520319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:09.528045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:09.535495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1224/2459] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:09.579176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:09.580926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:09.594588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503008af-546c-4ac9-ac2a-7d8d0166899b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:09.599912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e619a1b-26a9-4a26-8fbe-1c1f6fb3fcb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:09.600548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e619a1b-26a9-4a26-8fbe-1c1f6fb3fcb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:09.600823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e619a1b-26a9-4a26-8fbe-1c1f6fb3fcb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:09.601111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e619a1b-26a9-4a26-8fbe-1c1f6fb3fcb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:09.666976 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e619a1b-26a9-4a26-8fbe-1c1f6fb3fcb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:09.668645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e619a1b-26a9-4a26-8fbe-1c1f6fb3fcb0 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:09.678393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1236/2460] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:12.731048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:12.808345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c1fa-0e48-44a2-bcab-dc524d6d29f8 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:12.815794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:12.816840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:12.817283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:12.817736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] PATH_INFO: `/v3/users/a1e2fa4fe31841499e2ddacb47fe2873` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:12.819617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e2fa4fe31841499e2ddacb47fe2873)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:12.822641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:12.891694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e2fa4fe31841499e2ddacb47fe2873'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:12.904866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e2fa4fe31841499e2ddacb47fe2873'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:12.913685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e2fa4fe31841499e2ddacb47fe2873'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:12.914483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e2fa4fe31841499e2ddacb47fe2873'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:12.915181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e2fa4fe31841499e2ddacb47fe2873'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:12.931165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1225/2461] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:10:12 2022] DELETE /identity/v3/users/a1e2fa4fe31841499e2ddacb47fe2873 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:12.936409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:12.937002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:12.937002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:12.958230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:12.960329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.028826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1237/2462] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:13.039721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.041332 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.102648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a918-367d-491c-890c-25aa8343b97a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:13.106591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:13.107246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:13.107484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:13.107743 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.117604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:13.119059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:13.129905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1226/2463] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:10:13.455904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.457468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.471440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e67311-fd05-4b0a-91e2-ad668ea17fd7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:13.476284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:13.477030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:13.477302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:13.477581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] PATH_INFO: `/v3/projects/22e5e0774ef747b2b4f2a1a163c26d3f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.478788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e5e0774ef747b2b4f2a1a163c26d3f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:13.480705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:13.550049 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e5e0774ef747b2b4f2a1a163c26d3f', 'request_id': 'req-1183781e-1418-474b-9554-99391c91e359'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.555923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e5e0774ef747b2b4f2a1a163c26d3f', 'request_id': 'req-1183781e-1418-474b-9554-99391c91e359'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.565954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e5e0774ef747b2b4f2a1a163c26d3f', 'request_id': 'req-1183781e-1418-474b-9554-99391c91e359'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.578736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] The token cache is being invalidate because project 22e5e0774ef747b2b4f2a1a163c26d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:10:13.579046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.579791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.581484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1238/2464] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:10:13 2022] DELETE /identity/v3/projects/22e5e0774ef747b2b4f2a1a163c26d3f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:13.586090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.596789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622546f7-6b55-4818-a293-71ba5ce4b138 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:13.616135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:13.664946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:13.665576 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:13.665844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:13.666106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] PATH_INFO: `/v3/users/a248104201ad4db1bf857e0205a61659` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.667368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a248104201ad4db1bf857e0205a61659)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:13.669431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:13.736575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a248104201ad4db1bf857e0205a61659'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.753799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a248104201ad4db1bf857e0205a61659'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.767857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a248104201ad4db1bf857e0205a61659'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.768751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a248104201ad4db1bf857e0205a61659'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.769541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a248104201ad4db1bf857e0205a61659'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:13.793044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1227/2465] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:10:13 2022] DELETE /identity/v3/users/a248104201ad4db1bf857e0205a61659 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:14.115656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:14.117367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.132446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183781e-1418-474b-9554-99391c91e359 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:14.147305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:14.198255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:14.198940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.199190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.199455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] PATH_INFO: `/v3/projects/60b1e88515c6410eae9615a67b561155` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.201118 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b1e88515c6410eae9615a67b561155)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:14.202801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:14.258773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b1e88515c6410eae9615a67b561155', 'request_id': 'req-f623e66a-c3be-4e78-a415-59eaa1a148d2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.269733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b1e88515c6410eae9615a67b561155', 'request_id': 'req-f623e66a-c3be-4e78-a415-59eaa1a148d2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.276001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b1e88515c6410eae9615a67b561155', 'request_id': 'req-f623e66a-c3be-4e78-a415-59eaa1a148d2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.290023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] The token cache is being invalidate because project 60b1e88515c6410eae9615a67b561155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:10:14.290262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.290912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.292443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1239/2466] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:10:14 2022] DELETE /identity/v3/projects/60b1e88515c6410eae9615a67b561155 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:14.297064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:14.298542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.311845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd011-7b2c-4c55-8281-9a4aae32f265 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:14.384468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:14.385515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.385983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.386435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] PATH_INFO: `/v3/users/0c79402eab4f41f299fa40ff7efa1e62` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.387712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c79402eab4f41f299fa40ff7efa1e62)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:14.389940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:14.443832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:14.450065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c79402eab4f41f299fa40ff7efa1e62'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.471946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c79402eab4f41f299fa40ff7efa1e62'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.483644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c79402eab4f41f299fa40ff7efa1e62'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.483644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c79402eab4f41f299fa40ff7efa1e62'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.483644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b09b4124-9a01-47ac-9da3-b47f6f97c5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c79402eab4f41f299fa40ff7efa1e62'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:14.497097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1228/2467] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:10:14 2022] DELETE /identity/v3/users/0c79402eab4f41f299fa40ff7efa1e62 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:14.919208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:14.920894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.937672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e66a-c3be-4e78-a415-59eaa1a148d2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.016362 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.017062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.017345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.017621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] PATH_INFO: `/v3/projects/9d337763532c4844935cecc7e49712f6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.018946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d337763532c4844935cecc7e49712f6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.021136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.086543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d337763532c4844935cecc7e49712f6', 'request_id': 'req-e7071333-6622-4628-a0f0-0e582d878ae8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.087698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:15.093922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d337763532c4844935cecc7e49712f6', 'request_id': 'req-e7071333-6622-4628-a0f0-0e582d878ae8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.104729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d337763532c4844935cecc7e49712f6', 'request_id': 'req-e7071333-6622-4628-a0f0-0e582d878ae8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.118281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] The token cache is being invalidate because project 9d337763532c4844935cecc7e49712f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:10:15.118953 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.119256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e7071333-6622-4628-a0f0-0e582d878ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.120912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1240/2468] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:10:14 2022] DELETE /identity/v3/projects/9d337763532c4844935cecc7e49712f6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:15.132981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80a86a-036b-41b5-843c-bff6d077775b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.133520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80a86a-036b-41b5-843c-bff6d077775b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.133603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80a86a-036b-41b5-843c-bff6d077775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.154665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3a80a86a-036b-41b5-843c-bff6d077775b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:15.155924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a80a86a-036b-41b5-843c-bff6d077775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:15.223529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1229/2469] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:15.232933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d5fcf-6c76-4b9d-b9a9-df6ab6bf80d6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.233205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d5fcf-6c76-4b9d-b9a9-df6ab6bf80d6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.233484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d5fcf-6c76-4b9d-b9a9-df6ab6bf80d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.254871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cc6d5fcf-6c76-4b9d-b9a9-df6ab6bf80d6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:15.256128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cc6d5fcf-6c76-4b9d-b9a9-df6ab6bf80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:15.270706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1241/2470] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:15.275464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80a86a-036b-41b5-843c-bff6d077775b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.286046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80a86a-036b-41b5-843c-bff6d077775b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.290776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.291384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.291659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.291922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.292574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:10:15.292908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.295034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.307233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1230/2471] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:10:15.312060 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d5fcf-6c76-4b9d-b9a9-df6ab6bf80d6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.321633 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d5fcf-6c76-4b9d-b9a9-df6ab6bf80d6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.326690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.327305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.327563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.327825 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.328458 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.330388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.366420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1242/2472] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:10:15 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:15.370192 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.381259 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fddd7-864b-4052-8edd-c6e783a54e40 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.448667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.449361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.449634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.449903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.450619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.452890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.484471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1231/2473] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:10:15 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:15.489064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.500310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c0ecc-a9d2-45e4-bd13-269abf98d84f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.505243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.505858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.506284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.506547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.507195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.508792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.519873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1243/2474] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:15.525219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.535797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aae3c-e8cc-45d0-825c-94c03ad9aaa6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.540586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23260046-ea6b-424b-8a8e-2af7dc4f2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.541275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260046-ea6b-424b-8a8e-2af7dc4f2c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.541547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260046-ea6b-424b-8a8e-2af7dc4f2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.541804 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260046-ea6b-424b-8a8e-2af7dc4f2c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.542486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23260046-ea6b-424b-8a8e-2af7dc4f2c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.544101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23260046-ea6b-424b-8a8e-2af7dc4f2c77 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.563016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1232/2475] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:15.567454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.578858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7e91d-a7b2-46ca-81c7-fbded7e56ec4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.583933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.584777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.584922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.585186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] PATH_INFO: `/v3/projects/8b13768fef3a487290e73ab6c8068231/users/cf799bcba6a04374bd711e2cb9089a4f/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.604333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b13768fef3a487290e73ab6c8068231, user_id=cf799bcba6a04374bd711e2cb9089a4f, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.607123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.625497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1244/2476] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:15 2022] PUT /identity/v3/projects/8b13768fef3a487290e73ab6c8068231/users/cf799bcba6a04374bd711e2cb9089a4f/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:15.638430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7668b3-d569-4e05-a9fa-a85290ba248f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.638940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7668b3-d569-4e05-a9fa-a85290ba248f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.639221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7668b3-d569-4e05-a9fa-a85290ba248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.671379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a7668b3-d569-4e05-a9fa-a85290ba248f None None] MFA Rules not processed for user `cf799bcba6a04374bd711e2cb9089a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:15.672712 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a7668b3-d569-4e05-a9fa-a85290ba248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:15.686705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:15.753929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1233/2477] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:15.767505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.769554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:15.834841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574340-3282-41fd-9ce1-f0da6191cf32 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.839210 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cb645-8d53-400d-8754-590f7a48a381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.839859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cb645-8d53-400d-8754-590f7a48a381 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.840135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cb645-8d53-400d-8754-590f7a48a381 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.840404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cb645-8d53-400d-8754-590f7a48a381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.851794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0cb645-8d53-400d-8754-590f7a48a381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.853346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0cb645-8d53-400d-8754-590f7a48a381 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.863661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1245/2478] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:15.887258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7668b3-d569-4e05-a9fa-a85290ba248f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.958706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7668b3-d569-4e05-a9fa-a85290ba248f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.963740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.964392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.964667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.964971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] PATH_INFO: `/v3/users/cf799bcba6a04374bd711e2cb9089a4f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.966169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf799bcba6a04374bd711e2cb9089a4f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.968210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:16.026207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf799bcba6a04374bd711e2cb9089a4f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.038791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf799bcba6a04374bd711e2cb9089a4f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.045995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf799bcba6a04374bd711e2cb9089a4f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.046885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf799bcba6a04374bd711e2cb9089a4f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.047475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf799bcba6a04374bd711e2cb9089a4f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.063667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1234/2479] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:10:15 2022] DELETE /identity/v3/users/cf799bcba6a04374bd711e2cb9089a4f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:16.068307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.068584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.068933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.090421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:16.091950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:16.166664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1246/2480] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:10:16.182622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:16.184546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:16.227827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:16.249836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248257-1caa-404a-bef1-11e658954cf7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:16.253552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94409b0f-25db-41dc-9991-91f04882ac79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:16.254136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94409b0f-25db-41dc-9991-91f04882ac79 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.254410 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94409b0f-25db-41dc-9991-91f04882ac79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.254682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94409b0f-25db-41dc-9991-91f04882ac79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.264650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94409b0f-25db-41dc-9991-91f04882ac79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:16.266136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94409b0f-25db-41dc-9991-91f04882ac79 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:16.276510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1235/2481] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:16.589729 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:16.591499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:16.613465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3dc8-7132-4f9a-ba33-5c09aa4ed6e2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:16.619931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:16.620598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.620914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.621311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] PATH_INFO: `/v3/projects/8b13768fef3a487290e73ab6c8068231` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.623287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b13768fef3a487290e73ab6c8068231)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:16.626239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:16.640225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:16.685579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b13768fef3a487290e73ab6c8068231', 'request_id': 'req-ef9eca70-cbeb-4578-aa73-64e1b906f562'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.692777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b13768fef3a487290e73ab6c8068231', 'request_id': 'req-ef9eca70-cbeb-4578-aa73-64e1b906f562'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.702296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b13768fef3a487290e73ab6c8068231', 'request_id': 'req-ef9eca70-cbeb-4578-aa73-64e1b906f562'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.715121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] The token cache is being invalidate because project 8b13768fef3a487290e73ab6c8068231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:10:16.715409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.716459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef9eca70-cbeb-4578-aa73-64e1b906f562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.718125 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1247/2482] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:10:16 2022] DELETE /identity/v3/projects/8b13768fef3a487290e73ab6c8068231 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:16.724385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027516-db3b-461b-9137-747c4d2abddd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.724662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027516-db3b-461b-9137-747c4d2abddd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.724963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027516-db3b-461b-9137-747c4d2abddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.749342 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-31027516-db3b-461b-9137-747c4d2abddd None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:16.750644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-31027516-db3b-461b-9137-747c4d2abddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:16.817218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1236/2483] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:16.826090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35ed7-5fd6-4170-844c-edd217900c2a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.826648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35ed7-5fd6-4170-844c-edd217900c2a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.827042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35ed7-5fd6-4170-844c-edd217900c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.854030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4ea35ed7-5fd6-4170-844c-edd217900c2a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:16.855269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4ea35ed7-5fd6-4170-844c-edd217900c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:16.864569 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1248/2484] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:16.869253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027516-db3b-461b-9137-747c4d2abddd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:16.881669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027516-db3b-461b-9137-747c4d2abddd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:16.886967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:16.887485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.887762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.888025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.888685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:10:16.889008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:16.890657 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:16.903406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1237/2485] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:10:16.908428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35ed7-5fd6-4170-844c-edd217900c2a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:16.920473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35ed7-5fd6-4170-844c-edd217900c2a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:16.926034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:16.926799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.927078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.927347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.928157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:16.930174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:16.963020 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1249/2486] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:10:16 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:16.968922 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:16.980426 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294a8c9-b553-4612-a574-d391c923fee5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:17.052218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:17.053102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:17.053369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:17.053652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:17.054541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:17.057957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:17.092639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1238/2487] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:10:16 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:17.094127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:17.111465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58c2b-cefa-4b02-b848-d8adb47ee001 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:17.117236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:17.117831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:17.118107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:17.118382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:17.119054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:17.120832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:17.137368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1250/2488] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:17.142375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:17.153402 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a558de-325d-4493-9017-8c97a95d29f3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:17.159835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ede03-c9b8-499b-8e00-988498779173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:17.160649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ede03-c9b8-499b-8e00-988498779173 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:17.161045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ede03-c9b8-499b-8e00-988498779173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:17.161398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ede03-c9b8-499b-8e00-988498779173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:17.162092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ede03-c9b8-499b-8e00-988498779173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:17.163840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ede03-c9b8-499b-8e00-988498779173 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:17.184443 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1239/2489] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:17.190742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:17.202002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d669443-a125-4817-952c-9d059b36c2f8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:17.206763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:17.207452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:17.207721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:17.207995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] PATH_INFO: `/v3/projects/5a39388060904cd6ba4affce6db3bdb0/users/a239f55fb7544a18a28d47320421e24b/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:17.225203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a39388060904cd6ba4affce6db3bdb0, user_id=a239f55fb7544a18a28d47320421e24b, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:17.227812 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:17.242814 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1251/2490] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:17 2022] PUT /identity/v3/projects/5a39388060904cd6ba4affce6db3bdb0/users/a239f55fb7544a18a28d47320421e24b/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:17.248537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf9a37-6b60-4e66-9496-08faeca9c89a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:17.248842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf9a37-6b60-4e66-9496-08faeca9c89a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:17.249096 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf9a37-6b60-4e66-9496-08faeca9c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:17.274441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5caf9a37-6b60-4e66-9496-08faeca9c89a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:17.275720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5caf9a37-6b60-4e66-9496-08faeca9c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:17.319525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:17.342733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1240/2491] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:17.353345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:17.355264 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:17.420310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8f21-9d1b-4e37-9768-d0937c3c1b2e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:17.424581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:17.425248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:17.425528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:17.425810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:17.436158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:17.437649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:17.448310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1252/2492] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:22.435607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b9ac-2a3c-416a-9ff7-dbcfa5f94b22 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:22.436477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b9ac-2a3c-416a-9ff7-dbcfa5f94b22 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:22.436477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b9ac-2a3c-416a-9ff7-dbcfa5f94b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:22.483181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3006b9ac-2a3c-416a-9ff7-dbcfa5f94b22 None None] MFA Rules not processed for user `a239f55fb7544a18a28d47320421e24b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:22.484853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3006b9ac-2a3c-416a-9ff7-dbcfa5f94b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:22.604962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1241/2493] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:22.610257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:22.626598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a929760-e844-41e6-90f5-296e9c64fd0f service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:22.631511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:22.632171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:22.632449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:22.632722 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:22.633628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:22.635602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:22.673690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1253/2494] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:10:22 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:22.678468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b9ac-2a3c-416a-9ff7-dbcfa5f94b22 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:22.693972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b9ac-2a3c-416a-9ff7-dbcfa5f94b22 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:22.784045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:22.784645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:22.784955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:22.785223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:22.786431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:22.788106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:22.820920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1242/2495] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:10:22 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:22.821172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:22.834958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8eeb6-c7fd-4b88-92f3-d5cafb97180e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:22.842490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:22.843144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:22.843420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:22.843691 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:22.844552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:22.847667 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:22.864497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1254/2496] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:22.869289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:22.881991 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684ec6-a42c-4abd-833a-1b7286eba42f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:22.887793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:22.888638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:22.889023 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:22.889306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] PATH_INFO: `/v3/projects/3b7403b035204967a329bc4053027667/users/900d759561a74f1188790726339bd1f2/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:22.912795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7403b035204967a329bc4053027667, user_id=900d759561a74f1188790726339bd1f2, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:22.918067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:22.944537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1243/2497] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:22 2022] PUT /identity/v3/projects/3b7403b035204967a329bc4053027667/users/900d759561a74f1188790726339bd1f2/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:22.950235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:22.964387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b0733-1aea-4b43-89bf-c5d9d3451267 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:22.969853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:23.092096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433314a3-55d1-448c-88cb-03852af0e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:23.093164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433314a3-55d1-448c-88cb-03852af0e2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:23.093583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433314a3-55d1-448c-88cb-03852af0e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:23.094036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433314a3-55d1-448c-88cb-03852af0e2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:23.096311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433314a3-55d1-448c-88cb-03852af0e2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:23.099186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433314a3-55d1-448c-88cb-03852af0e2a9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:23.128157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1255/2498] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:23.132437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:23.159528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9ae80-5519-40aa-985c-42c7499c7097 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:23.165672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:23.166351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:23.166654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:23.166905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] PATH_INFO: `/v3/projects/3b7403b035204967a329bc4053027667/users/900d759561a74f1188790726339bd1f2/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:23.168948 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7403b035204967a329bc4053027667, user_id=900d759561a74f1188790726339bd1f2, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:23.172926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:23.188701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1244/2499] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:23 2022] PUT /identity/v3/projects/3b7403b035204967a329bc4053027667/users/900d759561a74f1188790726339bd1f2/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:25.947380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728108c0-01b0-4086-8f27-b183f9641662 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:25.948377 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728108c0-01b0-4086-8f27-b183f9641662 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:25.948840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728108c0-01b0-4086-8f27-b183f9641662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:26.007639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-728108c0-01b0-4086-8f27-b183f9641662 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:26.009025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-728108c0-01b0-4086-8f27-b183f9641662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:26.127140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1256/2500] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:26.211934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:26.218924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:26.291481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:26.436897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6baa0-cce0-4bdb-b135-3c647a433b62 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:26.444651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:26.445713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:26.446227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:26.446593 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:26.471340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:26.473568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:26.490654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1245/2501] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:10:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:10:28.919589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539682c-a159-4726-9d2f-deedd3f2733e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:28.920074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539682c-a159-4726-9d2f-deedd3f2733e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:28.920959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539682c-a159-4726-9d2f-deedd3f2733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:28.955800 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b539682c-a159-4726-9d2f-deedd3f2733e None None] MFA Rules not processed for user `900d759561a74f1188790726339bd1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:28.957311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b539682c-a159-4726-9d2f-deedd3f2733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:29.066889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1257/2502] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:29.089940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:29.092139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:29.261012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeab25-ae9f-462c-b297-457e02aef3d4 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:29.271054 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:29.271688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:29.271968 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:29.272225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:29.375690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:29.399801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:29.401514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:29.460081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1246/2503] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:31.204193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eddd19-70e5-4fb6-88f3-d4784fa0da0d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:31.204842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eddd19-70e5-4fb6-88f3-d4784fa0da0d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:31.204842 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eddd19-70e5-4fb6-88f3-d4784fa0da0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:31.229413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e3eddd19-70e5-4fb6-88f3-d4784fa0da0d None None] MFA Rules not processed for user `a239f55fb7544a18a28d47320421e24b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:31.230860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e3eddd19-70e5-4fb6-88f3-d4784fa0da0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:31.239425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1258/2504] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:38.443175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:38.444771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:38.543848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754811b-e9d1-454a-a06a-636cf89527f0 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:38.550383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:38.551079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:38.551428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:38.551765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:38.553799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:38.566487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:38.568132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:38.579362 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1247/2505] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:41.220363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:45.643080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831066-0e2c-4a15-b0c8-ffd13ef200ac None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:45.643970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831066-0e2c-4a15-b0c8-ffd13ef200ac None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:45.643970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53831066-0e2c-4a15-b0c8-ffd13ef200ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:45.674494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-53831066-0e2c-4a15-b0c8-ffd13ef200ac None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:45.675952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-53831066-0e2c-4a15-b0c8-ffd13ef200ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:45.683847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1259/2506] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:45.699146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:45.713255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac630-b6cb-4d96-a1fe-70acf1494a29 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:45.719629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:45.720500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:45.720777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:45.721239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:45.730215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:45.731843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:45.740746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1248/2507] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:10:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:10:55.672988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:55.737116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=53 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:10.335787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:10.336386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:10.336386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:10.359516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:10.361129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:10.370248 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1260/2508] 10.222.0.89 () {58 vars in 967 bytes} [Tue Aug 30 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:10.388182 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:10.401295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4e15-7b75-45b5-bc7d-6624d30d77a4 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:10.411000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:10.411632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:10.411906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:10.412181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:10.421794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:10.423461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:10.432950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1249/2509] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:11:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:11:16.640311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:16.641812 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:16.720840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716cb13-4d84-456c-881e-09b3c6fb3aa5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:16.724600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:16.725236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:16.725510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:16.725776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:16.735804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:16.737326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:16.754179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1261/2510] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:20.428788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:26.143855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:26.158277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bfcc7-16aa-47d3-8bad-ac254fcd27e2 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:26.162674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:26.164544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:26.167063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:26.167439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:26.169758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:26.266652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:26.268110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:26.292112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1250/2511] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:26.743063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=38 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:29.745810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:29.747811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:29.769132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e8d46-6df3-4598-979f-3a36c8d33738 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:29.774588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:29.775235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:29.775509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:29.775781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] PATH_INFO: `/v3/users/b6b474e9ef2e49b3a27b73d8ffd385b1` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:29.777109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b474e9ef2e49b3a27b73d8ffd385b1)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:29.779067 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:29.835183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b474e9ef2e49b3a27b73d8ffd385b1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:29.844896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b474e9ef2e49b3a27b73d8ffd385b1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:29.855542 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b474e9ef2e49b3a27b73d8ffd385b1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:29.856425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b474e9ef2e49b3a27b73d8ffd385b1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:29.879998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9015c935-f84a-43b3-8017-da9ead26335b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b474e9ef2e49b3a27b73d8ffd385b1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:29.890967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1262/2512] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:29 2022] DELETE /identity/v3/users/b6b474e9ef2e49b3a27b73d8ffd385b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:30.080771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:30.094914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725fa5c-4a96-42a6-a8b0-d40a1c50350a service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:30.158393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:30.158941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.159219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.159523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] PATH_INFO: `/v3/projects/95425d9bc2cd491eb337f88c5bb8095c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.161012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95425d9bc2cd491eb337f88c5bb8095c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:30.162943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:30.216151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95425d9bc2cd491eb337f88c5bb8095c', 'request_id': 'req-1e88316e-a668-41e7-ad11-90f6b3430bf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:30.223270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95425d9bc2cd491eb337f88c5bb8095c', 'request_id': 'req-1e88316e-a668-41e7-ad11-90f6b3430bf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:30.229487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95425d9bc2cd491eb337f88c5bb8095c', 'request_id': 'req-1e88316e-a668-41e7-ad11-90f6b3430bf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:30.233847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:30.247199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] The token cache is being invalidate because project 95425d9bc2cd491eb337f88c5bb8095c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:30.247491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:30.248449 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1e88316e-a668-41e7-ad11-90f6b3430bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:30.250047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1251/2513] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:30 2022] DELETE /identity/v3/projects/95425d9bc2cd491eb337f88c5bb8095c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:30.255908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe848-50c3-4147-8683-0ecd375589ec None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.256247 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe848-50c3-4147-8683-0ecd375589ec None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.256446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe848-50c3-4147-8683-0ecd375589ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.326261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-07afe848-50c3-4147-8683-0ecd375589ec None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:30.327512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-07afe848-50c3-4147-8683-0ecd375589ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:30.398958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1263/2514] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:30.407773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aeef5-0c26-492c-a861-ef6e399b47d1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.408048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aeef5-0c26-492c-a861-ef6e399b47d1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.408346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aeef5-0c26-492c-a861-ef6e399b47d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.430622 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-028aeef5-0c26-492c-a861-ef6e399b47d1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:30.431809 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-028aeef5-0c26-492c-a861-ef6e399b47d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:30.440132 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1252/2515] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:30.444715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afe848-50c3-4147-8683-0ecd375589ec None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:30.455283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afe848-50c3-4147-8683-0ecd375589ec None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:30.460908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:30.461523 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.461798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.462063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.462711 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:11:30.463009 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:30.464873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:30.478257 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1264/2516] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:11:30.483151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aeef5-0c26-492c-a861-ef6e399b47d1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:30.493749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aeef5-0c26-492c-a861-ef6e399b47d1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:30.501048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:30.501812 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.502210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.502580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.503307 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:30.505514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:30.550674 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1253/2517] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:30 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:30.556053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:30.567916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187279c-f756-409b-bc2e-51a39b47c1ec admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:30.602359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:30.652186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:30.652850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.653144 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.653415 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.654056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:30.656004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:30.680751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1265/2518] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:30 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:11:30.685092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:30.696169 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b09978-e530-4f3f-beba-0476633899f8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:30.702233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:30.702838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.703114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.703377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.704050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:30.705809 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:30.716860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1254/2519] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:30.721482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:30.734725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742f642-5640-4ca7-8bc1-e6b8649b48a5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:30.739520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ba1cc-c806-485d-8839-6b8925a69c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:30.740138 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ba1cc-c806-485d-8839-6b8925a69c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.740418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ba1cc-c806-485d-8839-6b8925a69c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.740717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ba1cc-c806-485d-8839-6b8925a69c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.741481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ba1cc-c806-485d-8839-6b8925a69c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:30.743075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ba1cc-c806-485d-8839-6b8925a69c7b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:30.755186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1266/2520] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:30.759548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:30.773050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4335f-c723-4368-a7ab-1d7f08cf9df2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:30.778825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:30.779510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.779915 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.780065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] PATH_INFO: `/v3/projects/23bc7c88c9374e04985b5565ed4d54e8/users/fadeebd17fe046098f7bd24fada68115/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.801078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bc7c88c9374e04985b5565ed4d54e8, user_id=fadeebd17fe046098f7bd24fada68115, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:30.803826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:30.818846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1255/2521] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:30 2022] PUT /identity/v3/projects/23bc7c88c9374e04985b5565ed4d54e8/users/fadeebd17fe046098f7bd24fada68115/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:30.829932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb517fa-b4c8-47d6-bb40-ad9e099c7dd7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:30.830263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb517fa-b4c8-47d6-bb40-ad9e099c7dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:30.830604 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb517fa-b4c8-47d6-bb40-ad9e099c7dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:30.861054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2eb517fa-b4c8-47d6-bb40-ad9e099c7dd7 None None] MFA Rules not processed for user `fadeebd17fe046098f7bd24fada68115`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:30.862286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2eb517fa-b4c8-47d6-bb40-ad9e099c7dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:30.939250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1267/2522] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:30.946425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:31.018276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309efa-8d36-4d24-bfb2-f76ef73d0de3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:31.023422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:31.024020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.024295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.024559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.025260 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:31.027475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:31.056548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1256/2523] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:30 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:31.061072 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb517fa-b4c8-47d6-bb40-ad9e099c7dd7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:31.073975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb517fa-b4c8-47d6-bb40-ad9e099c7dd7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:31.138583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:31.139207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.139477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.139761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.140393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:31.142389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:31.165695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1268/2524] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:31 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:31.170238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:31.181245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230563-b8dd-4c94-9d16-32fb72d532c8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:31.187510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:31.188162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.188438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.188707 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.189453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:31.191005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:31.202934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1257/2525] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:31.208517 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:31.219911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff439c-d8eb-4371-9b57-d8417aa327c3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:31.225051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:31.225786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.226087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.226392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] PATH_INFO: `/v3/projects/65056ac95c2b44abaa2ba38f29244471/users/8ef7650f3e424f76b6a9031dece5a0e8/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.242587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65056ac95c2b44abaa2ba38f29244471, user_id=8ef7650f3e424f76b6a9031dece5a0e8, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:31.245603 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:31.268375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1269/2526] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:31 2022] PUT /identity/v3/projects/65056ac95c2b44abaa2ba38f29244471/users/8ef7650f3e424f76b6a9031dece5a0e8/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:31.274136 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:31.292606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8b7d-6ada-4f85-8ceb-c40415703dda admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:31.361538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08a17c-3522-4427-b04a-c61c3ea9e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:31.362148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08a17c-3522-4427-b04a-c61c3ea9e814 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.362434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08a17c-3522-4427-b04a-c61c3ea9e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.362699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08a17c-3522-4427-b04a-c61c3ea9e814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.363343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08a17c-3522-4427-b04a-c61c3ea9e814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:31.365001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08a17c-3522-4427-b04a-c61c3ea9e814 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:31.376476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1258/2527] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:31.381226 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:31.388455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:31.406913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85814eb-6649-463b-b861-e9e44e2a29c8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:31.412419 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:31.413128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.413405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.413668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] PATH_INFO: `/v3/projects/65056ac95c2b44abaa2ba38f29244471/users/8ef7650f3e424f76b6a9031dece5a0e8/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.415715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65056ac95c2b44abaa2ba38f29244471, user_id=8ef7650f3e424f76b6a9031dece5a0e8, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:31.418580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:31.429334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1270/2528] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:31 2022] PUT /identity/v3/projects/65056ac95c2b44abaa2ba38f29244471/users/8ef7650f3e424f76b6a9031dece5a0e8/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:31.441747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf985-ab14-4106-87a7-9510516fc2fe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.441956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf985-ab14-4106-87a7-9510516fc2fe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.442221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf985-ab14-4106-87a7-9510516fc2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.450045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:31.473817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f9daf985-ab14-4106-87a7-9510516fc2fe None None] MFA Rules not processed for user `8ef7650f3e424f76b6a9031dece5a0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:31.475062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f9daf985-ab14-4106-87a7-9510516fc2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:31.560077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1259/2529] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:31.571896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:31.573700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:31.655355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247cd3-2e0f-4988-a36a-1913351a4b83 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:31.659286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc9254-2d1c-40a3-84d4-ef5a8dcf3bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:31.659964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9254-2d1c-40a3-84d4-ef5a8dcf3bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:31.660235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9254-2d1c-40a3-84d4-ef5a8dcf3bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:31.660503 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9254-2d1c-40a3-84d4-ef5a8dcf3bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:31.671341 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc9254-2d1c-40a3-84d4-ef5a8dcf3bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:31.672881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc9254-2d1c-40a3-84d4-ef5a8dcf3bf4 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:31.688160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1271/2530] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:32.140763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daf985-ab14-4106-87a7-9510516fc2fe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:32.206112 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daf985-ab14-4106-87a7-9510516fc2fe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:32.211350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:32.212012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:32.212315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:32.212563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] PATH_INFO: `/v3/users/fadeebd17fe046098f7bd24fada68115` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:32.213795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadeebd17fe046098f7bd24fada68115)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:32.215849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:32.270721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadeebd17fe046098f7bd24fada68115'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.282335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadeebd17fe046098f7bd24fada68115'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.289481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadeebd17fe046098f7bd24fada68115'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.290185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadeebd17fe046098f7bd24fada68115'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.290810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadeebd17fe046098f7bd24fada68115'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.307075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1260/2531] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:32 2022] DELETE /identity/v3/users/fadeebd17fe046098f7bd24fada68115 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:32.311933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:32.312456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:32.312456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:32.332078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:32.333300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:32.396710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1272/2532] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:32.409235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:32.410720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:32.421407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:32.477444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29954b32-4426-4dfa-a0d0-0763e23d801a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:32.481612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:32.482199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:32.482497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:32.482764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:32.492364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:32.493924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:32.504069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1261/2533] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:32.796321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:32.797954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:32.810966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eefae-a20e-45ee-b8db-c4806d19a34d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:32.816174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:32.816834 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:32.817148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:32.817420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] PATH_INFO: `/v3/projects/23bc7c88c9374e04985b5565ed4d54e8` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:32.818572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bc7c88c9374e04985b5565ed4d54e8)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:32.820832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:32.881449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bc7c88c9374e04985b5565ed4d54e8', 'request_id': 'req-3c45267d-72b9-478e-9520-3911ca5c7d37'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.888705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bc7c88c9374e04985b5565ed4d54e8', 'request_id': 'req-3c45267d-72b9-478e-9520-3911ca5c7d37'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.898918 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bc7c88c9374e04985b5565ed4d54e8', 'request_id': 'req-3c45267d-72b9-478e-9520-3911ca5c7d37'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.901859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:32.913387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] The token cache is being invalidate because project 23bc7c88c9374e04985b5565ed4d54e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:32.914057 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.915076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:32.919731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1273/2534] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:32 2022] DELETE /identity/v3/projects/23bc7c88c9374e04985b5565ed4d54e8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:32.921027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:32.931265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541017fa-3abd-4c31-af2a-b4e3ccebbd54 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:33.011050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:33.012008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.012291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.012557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] PATH_INFO: `/v3/users/8ef7650f3e424f76b6a9031dece5a0e8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.013770 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef7650f3e424f76b6a9031dece5a0e8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:33.015746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:33.071840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef7650f3e424f76b6a9031dece5a0e8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.085886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef7650f3e424f76b6a9031dece5a0e8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.094519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef7650f3e424f76b6a9031dece5a0e8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.095292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef7650f3e424f76b6a9031dece5a0e8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.095906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c779e01-2e3a-4d2b-9b75-fa319590465e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef7650f3e424f76b6a9031dece5a0e8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.112457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1262/2535] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:32 2022] DELETE /identity/v3/users/8ef7650f3e424f76b6a9031dece5a0e8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:11:33.427117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:33.428750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:33.443860 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45267d-72b9-478e-9520-3911ca5c7d37 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:33.511782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:33.512589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.512930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.513209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] PATH_INFO: `/v3/projects/65056ac95c2b44abaa2ba38f29244471` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.514478 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65056ac95c2b44abaa2ba38f29244471)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:33.516408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:33.567355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65056ac95c2b44abaa2ba38f29244471', 'request_id': 'req-396094c8-2509-44d8-b7f0-d305bddb7568'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.572656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65056ac95c2b44abaa2ba38f29244471', 'request_id': 'req-396094c8-2509-44d8-b7f0-d305bddb7568'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.582185 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65056ac95c2b44abaa2ba38f29244471', 'request_id': 'req-396094c8-2509-44d8-b7f0-d305bddb7568'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.594579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] The token cache is being invalidate because project 65056ac95c2b44abaa2ba38f29244471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:33.594862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.595509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-396094c8-2509-44d8-b7f0-d305bddb7568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:33.597066 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1274/2536] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:33 2022] DELETE /identity/v3/projects/65056ac95c2b44abaa2ba38f29244471 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:33.602438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925c5b0-8bde-4ebb-803b-b3d04e7b93ad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.602943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925c5b0-8bde-4ebb-803b-b3d04e7b93ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.603043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925c5b0-8bde-4ebb-803b-b3d04e7b93ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.624072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d925c5b0-8bde-4ebb-803b-b3d04e7b93ad None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:33.625339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d925c5b0-8bde-4ebb-803b-b3d04e7b93ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:33.652904 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:33.692762 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1263/2537] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:11:33.701367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dec458-02ed-48d0-94c0-cd89d112c24c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.701646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dec458-02ed-48d0-94c0-cd89d112c24c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.701912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dec458-02ed-48d0-94c0-cd89d112c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.724033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-19dec458-02ed-48d0-94c0-cd89d112c24c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:33.725305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-19dec458-02ed-48d0-94c0-cd89d112c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:33.734952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1275/2538] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:33.739484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925c5b0-8bde-4ebb-803b-b3d04e7b93ad None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:33.753010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925c5b0-8bde-4ebb-803b-b3d04e7b93ad None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:33.759247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:33.759873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.760144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.760404 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.761133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:11:33.761432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:33.763254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:33.775666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1264/2539] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:11:33.780271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dec458-02ed-48d0-94c0-cd89d112c24c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:33.789881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dec458-02ed-48d0-94c0-cd89d112c24c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:33.794821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:33.795434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.795705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.795969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.796621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:33.798577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:33.832182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1276/2540] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:33 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:33.842608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:33.853930 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af64e-ea65-481b-8091-920bb4ac2d44 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:33.916388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:33.917181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.918175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.918636 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.919290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:33.921318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:33.946623 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1265/2541] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:33 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:33.951512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:33.964336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f98d12-2983-42cc-b58d-efbd7600ecfd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:33.971920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:33.972560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:33.972826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:33.973107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:33.973747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:33.975347 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:33.989090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1277/2542] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:33.993430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.005671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd264d-bd9c-4735-bc23-11a590052eb6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.011688 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae9dc-170f-4d1d-9ab2-189a4616f917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.012489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae9dc-170f-4d1d-9ab2-189a4616f917 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.012773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae9dc-170f-4d1d-9ab2-189a4616f917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.013072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae9dc-170f-4d1d-9ab2-189a4616f917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.013886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae9dc-170f-4d1d-9ab2-189a4616f917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.015514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae9dc-170f-4d1d-9ab2-189a4616f917 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.028157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1266/2543] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:34.032385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.043224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5402-5b27-4cd0-b87b-bf844f14b8ea admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.049311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.050186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.050593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.051031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] PATH_INFO: `/v3/projects/54a11798a1594e7ca92665f1f022d662/users/6db64540cbb649e3b4d6cb5aa80cff08/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.069177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a11798a1594e7ca92665f1f022d662, user_id=6db64540cbb649e3b4d6cb5aa80cff08, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.071936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.089865 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1278/2544] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:34 2022] PUT /identity/v3/projects/54a11798a1594e7ca92665f1f022d662/users/6db64540cbb649e3b4d6cb5aa80cff08/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:34.102493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54189031-1bce-4c20-808a-b9d670bb1ffc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.102773 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54189031-1bce-4c20-808a-b9d670bb1ffc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.103042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54189031-1bce-4c20-808a-b9d670bb1ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.133166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-54189031-1bce-4c20-808a-b9d670bb1ffc None None] MFA Rules not processed for user `6db64540cbb649e3b4d6cb5aa80cff08`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:34.134418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-54189031-1bce-4c20-808a-b9d670bb1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:34.207277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1267/2545] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:34.212622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.241019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:34.285091 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4ebfa-e6f2-4202-872b-2a87e995149a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.290794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.291546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.291965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.292334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.293158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.295043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.324421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1279/2546] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:34 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:34.328571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54189031-1bce-4c20-808a-b9d670bb1ffc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.340751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54189031-1bce-4c20-808a-b9d670bb1ffc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.361726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:34.405528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.406171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.406467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.406731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.407412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.409610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.441498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1268/2547] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:34 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:11:34.442748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.462135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032e7a6-f1bc-40f7-9f15-4d10c88c6d15 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.462135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.462135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.462135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.462622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.462622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.463456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.476374 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1280/2548] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:34.481370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.492286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3968-7237-4c73-9757-db74eefa756c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.497789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.498456 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.498727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.498996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] PATH_INFO: `/v3/projects/ada82b7123a84d418bc9d6ee2a0d457c/users/f96b20289b094e48a0962b588f906799/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.517224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada82b7123a84d418bc9d6ee2a0d457c, user_id=f96b20289b094e48a0962b588f906799, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.520055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.536152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1269/2549] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:34 2022] PUT /identity/v3/projects/ada82b7123a84d418bc9d6ee2a0d457c/users/f96b20289b094e48a0962b588f906799/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:34.540218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.550862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f30ef1-f564-4a50-a577-e048ef540ed5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.615544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83e510-af69-447f-9f44-e751ae92df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.616065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83e510-af69-447f-9f44-e751ae92df46 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.616343 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83e510-af69-447f-9f44-e751ae92df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.616608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83e510-af69-447f-9f44-e751ae92df46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.617286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83e510-af69-447f-9f44-e751ae92df46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.619021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83e510-af69-447f-9f44-e751ae92df46 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.629975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1281/2550] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:34.634468 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.645664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df94ef8-c14e-4d64-96f5-858b7eb29a82 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.650708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.651492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.651919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.652791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] PATH_INFO: `/v3/projects/ada82b7123a84d418bc9d6ee2a0d457c/users/f96b20289b094e48a0962b588f906799/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.655388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada82b7123a84d418bc9d6ee2a0d457c, user_id=f96b20289b094e48a0962b588f906799, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.658072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.669765 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1270/2551] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:34 2022] PUT /identity/v3/projects/ada82b7123a84d418bc9d6ee2a0d457c/users/f96b20289b094e48a0962b588f906799/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:11:34.680543 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0419ac9-c7d7-4c93-8a33-790945178c6a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.680853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0419ac9-c7d7-4c93-8a33-790945178c6a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.681126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0419ac9-c7d7-4c93-8a33-790945178c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.712384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c0419ac9-c7d7-4c93-8a33-790945178c6a None None] MFA Rules not processed for user `f96b20289b094e48a0962b588f906799`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:34.713645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c0419ac9-c7d7-4c93-8a33-790945178c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:34.787390 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1282/2552] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:34.799905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.801799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:34.865874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7a7b3-7f1d-4f44-932e-d36628be23ad admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.869832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.870517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.870869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.871148 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:34.881040 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:34.882480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:34.892492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1271/2553] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:34.976339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0419ac9-c7d7-4c93-8a33-790945178c6a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:34.989254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0419ac9-c7d7-4c93-8a33-790945178c6a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:34.993254 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765faec-d704-4a71-9448-6af159260a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:34.993864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765faec-d704-4a71-9448-6af159260a58 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:34.994140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765faec-d704-4a71-9448-6af159260a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:34.994408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765faec-d704-4a71-9448-6af159260a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:35.009948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:35.059220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765faec-d704-4a71-9448-6af159260a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:35.060659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765faec-d704-4a71-9448-6af159260a58 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:35.070943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1283/2554] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:35.387559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:35.467735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ae71-8e13-42ec-96ca-8b4902b76d98 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:35.473061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:35.473700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:35.473969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:35.474233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] PATH_INFO: `/v3/users/6db64540cbb649e3b4d6cb5aa80cff08` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:35.475687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db64540cbb649e3b4d6cb5aa80cff08)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:35.477272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:35.504126 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:35.537346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db64540cbb649e3b4d6cb5aa80cff08'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:35.564373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db64540cbb649e3b4d6cb5aa80cff08'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:35.574521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db64540cbb649e3b4d6cb5aa80cff08'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:35.575303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db64540cbb649e3b4d6cb5aa80cff08'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:35.575893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db64540cbb649e3b4d6cb5aa80cff08'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:35.590243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1272/2555] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:35 2022] DELETE /identity/v3/users/6db64540cbb649e3b4d6cb5aa80cff08 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:35.596270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:35.596885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:35.597220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:35.628920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:35.630058 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:35.696388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1284/2556] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:11:35.706840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:35.708354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:35.777124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90c633-ed66-41d8-9f38-cc2f47e4b69c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:35.780091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:35.780959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:35.781345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:35.781733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:35.793562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:35.795125 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:35.808840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1273/2557] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:36.107653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:36.109550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:36.127521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d777ccf-e8d9-4fdb-81e7-c2ba91916413 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:36.133669 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:36.134320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:36.134536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:36.134801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] PATH_INFO: `/v3/projects/54a11798a1594e7ca92665f1f022d662` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:36.136830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a11798a1594e7ca92665f1f022d662)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:36.138282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:36.189965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a11798a1594e7ca92665f1f022d662', 'request_id': 'req-a1d60f5f-7f49-473d-8def-6c5f87acff8c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.195620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a11798a1594e7ca92665f1f022d662', 'request_id': 'req-a1d60f5f-7f49-473d-8def-6c5f87acff8c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.204678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a11798a1594e7ca92665f1f022d662', 'request_id': 'req-a1d60f5f-7f49-473d-8def-6c5f87acff8c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.217083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] The token cache is being invalidate because project 54a11798a1594e7ca92665f1f022d662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:36.217368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.218336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.219844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1285/2558] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:36 2022] DELETE /identity/v3/projects/54a11798a1594e7ca92665f1f022d662 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:36.224564 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:36.237353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0816a6-1e93-4815-979c-e4f2cf5145a9 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:36.299347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:36.300109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:36.300387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:36.300665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] PATH_INFO: `/v3/users/f96b20289b094e48a0962b588f906799` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:36.307116 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96b20289b094e48a0962b588f906799)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:36.309772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:36.365892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:36.368656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96b20289b094e48a0962b588f906799'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.383031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96b20289b094e48a0962b588f906799'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.390696 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96b20289b094e48a0962b588f906799'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.391370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96b20289b094e48a0962b588f906799'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.391966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a853c2c-644a-488d-a553-1372dfd0223c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96b20289b094e48a0962b588f906799'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.408749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1274/2559] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:36 2022] DELETE /identity/v3/users/f96b20289b094e48a0962b588f906799 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:36.706624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:36.708232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:36.723405 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d60f5f-7f49-473d-8def-6c5f87acff8c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:36.773371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:36.793705 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:36.794332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:36.794582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:36.794868 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] PATH_INFO: `/v3/projects/ada82b7123a84d418bc9d6ee2a0d457c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:36.796050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada82b7123a84d418bc9d6ee2a0d457c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:36.797990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:36.857151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada82b7123a84d418bc9d6ee2a0d457c', 'request_id': 'req-e6090ddb-a863-4750-83ea-57cf230b1801'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.863317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada82b7123a84d418bc9d6ee2a0d457c', 'request_id': 'req-e6090ddb-a863-4750-83ea-57cf230b1801'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.872889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada82b7123a84d418bc9d6ee2a0d457c', 'request_id': 'req-e6090ddb-a863-4750-83ea-57cf230b1801'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.888461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] The token cache is being invalidate because project ada82b7123a84d418bc9d6ee2a0d457c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:36.888747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.889513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e6090ddb-a863-4750-83ea-57cf230b1801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:36.891223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1286/2560] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:36 2022] DELETE /identity/v3/projects/ada82b7123a84d418bc9d6ee2a0d457c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:36.896856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c45623-7f2b-41c4-ac65-972686d071f6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:36.897581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c45623-7f2b-41c4-ac65-972686d071f6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:36.898015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c45623-7f2b-41c4-ac65-972686d071f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:36.921078 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e5c45623-7f2b-41c4-ac65-972686d071f6 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:36.922303 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e5c45623-7f2b-41c4-ac65-972686d071f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:36.990097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1275/2561] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:36.997647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86584-9f91-4983-869d-c0c67ad639aa None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:36.997904 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86584-9f91-4983-869d-c0c67ad639aa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:36.998186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86584-9f91-4983-869d-c0c67ad639aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.026622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-00e86584-9f91-4983-869d-c0c67ad639aa None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:37.027998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-00e86584-9f91-4983-869d-c0c67ad639aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:37.039051 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1287/2562] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:37.045346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c45623-7f2b-41c4-ac65-972686d071f6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:37.059955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c45623-7f2b-41c4-ac65-972686d071f6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:37.064834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:37.065460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.065731 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.065996 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.066655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:11:37.066950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:37.068603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:37.083063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1276/2563] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:11:37.089490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86584-9f91-4983-869d-c0c67ad639aa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:37.099483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86584-9f91-4983-869d-c0c67ad639aa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:37.104896 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:37.105596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.105937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.106191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.106863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:37.108989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:37.139307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1288/2564] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:37 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:37.143512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:37.155235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6db7-a21e-4836-9dea-7a9a5e06a7fd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:37.224708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:37.225365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.225646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.225918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.226566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:37.228514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:37.253632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1277/2565] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:37 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:37.257771 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:37.268717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a7357-8005-45fa-9ce0-196af4b05b88 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:37.274612 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:37.275296 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.275581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.275856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.276504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:37.289703 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:37.304055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1289/2566] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:37.305339 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:37.317211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255a30a-3fd2-488a-b6f4-b8255c997142 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:37.322262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d9f6-b51e-4192-8990-23c057985096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:37.322925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d9f6-b51e-4192-8990-23c057985096 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.323220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d9f6-b51e-4192-8990-23c057985096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.323526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d9f6-b51e-4192-8990-23c057985096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.324646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d9f6-b51e-4192-8990-23c057985096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:37.326360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d9f6-b51e-4192-8990-23c057985096 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:37.338772 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1278/2567] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:37.344490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:37.354747 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b039ac-3038-4bf7-8d4c-6603b345d5f8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:37.361657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:37.362243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.362710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.362884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] PATH_INFO: `/v3/projects/ef4bf7c6e4064df180d753b9f67b0b06/users/a3dccb7a525b44c5956bd910067a3653/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.380400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4bf7c6e4064df180d753b9f67b0b06, user_id=a3dccb7a525b44c5956bd910067a3653, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:37.383433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:37.399968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1290/2568] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:37 2022] PUT /identity/v3/projects/ef4bf7c6e4064df180d753b9f67b0b06/users/a3dccb7a525b44c5956bd910067a3653/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:37.405228 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2a299-578a-40fe-954e-6ae4a0e0b48f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.405569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2a299-578a-40fe-954e-6ae4a0e0b48f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.405794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2a299-578a-40fe-954e-6ae4a0e0b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.425775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9ab2a299-578a-40fe-954e-6ae4a0e0b48f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:37.427010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ab2a299-578a-40fe-954e-6ae4a0e0b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:37.447966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:37.499728 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1279/2569] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:37.510073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:37.513584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:37.581071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df52f7-4830-443c-afc8-7fbfca802d93 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:37.585015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:37.585634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:37.585911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:37.586182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:37.596040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:37.597508 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:37.607101 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1291/2570] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:38.269602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711603-4462-46b0-a269-f5d066af518a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:38.270119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711603-4462-46b0-a269-f5d066af518a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:38.270119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711603-4462-46b0-a269-f5d066af518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:38.303234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-85711603-4462-46b0-a269-f5d066af518a None None] MFA Rules not processed for user `a3dccb7a525b44c5956bd910067a3653`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:38.304455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-85711603-4462-46b0-a269-f5d066af518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:38.383066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1280/2571] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:38.386150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:38.397260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb37e8-49e7-40fe-8374-892d1edec8e7 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:38.401807 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:38.402466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:38.402748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:38.403021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:38.404414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:38.406186 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:38.411244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:38.437660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1292/2572] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:38 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:38.441790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711603-4462-46b0-a269-f5d066af518a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:38.453196 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711603-4462-46b0-a269-f5d066af518a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:38.511288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:38.512022 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:38.512295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:38.512560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:38.513295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:38.518774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:38.543476 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1281/2573] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:38 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:38.548545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:38.563731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09cd2-78bb-4c09-bfe8-b1b245796a67 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:38.569855 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:38.570468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:38.570749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:38.571023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:38.571678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:38.573380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:38.586188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1293/2574] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:38.590873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:38.602354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d48280-9bcf-4161-8f66-a662b046e9ce admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:38.608624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:38.609350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:38.609624 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:38.610300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] PATH_INFO: `/v3/projects/d322f450d7a9472bb7548c9cb06b9ed5/users/103acc8e6fee488382b80ead1f89c5a3/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:38.627779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d322f450d7a9472bb7548c9cb06b9ed5, user_id=103acc8e6fee488382b80ead1f89c5a3, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:38.630841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:38.646064 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1282/2575] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:38 2022] PUT /identity/v3/projects/d322f450d7a9472bb7548c9cb06b9ed5/users/103acc8e6fee488382b80ead1f89c5a3/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:38.650413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:38.661783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188958-ee87-4abb-85de-31b932a886a2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:38.725864 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9873-e531-4b9f-a7f1-4a3b04e6e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:38.726496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9873-e531-4b9f-a7f1-4a3b04e6e7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:38.726770 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9873-e531-4b9f-a7f1-4a3b04e6e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:38.727088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9873-e531-4b9f-a7f1-4a3b04e6e7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:38.727749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9873-e531-4b9f-a7f1-4a3b04e6e7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:38.729495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9873-e531-4b9f-a7f1-4a3b04e6e7d5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:38.741314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1294/2576] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:38.745757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:38.759848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab8a8-90c7-4f7f-8351-87d4713fae35 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:38.765046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b604f-6d94-4970-b5d0-cd3d4c8d3c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:38.765713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b604f-6d94-4970-b5d0-cd3d4c8d3c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:38.765987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b604f-6d94-4970-b5d0-cd3d4c8d3c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:38.766255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b604f-6d94-4970-b5d0-cd3d4c8d3c42 admin admin] PATH_INFO: `/v3/projects/d322f450d7a9472bb7548c9cb06b9ed5/users/103acc8e6fee488382b80ead1f89c5a3/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:38.769029 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b604f-6d94-4970-b5d0-cd3d4c8d3c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d322f450d7a9472bb7548c9cb06b9ed5, user_id=103acc8e6fee488382b80ead1f89c5a3, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:38.771730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b604f-6d94-4970-b5d0-cd3d4c8d3c42 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:38.783742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1283/2577] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:38 2022] PUT /identity/v3/projects/d322f450d7a9472bb7548c9cb06b9ed5/users/103acc8e6fee488382b80ead1f89c5a3/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:39.453583 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:39.454107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:39.454107 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:39.487817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] MFA Rules not processed for user `103acc8e6fee488382b80ead1f89c5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:39.489094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:39.584947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1295/2578] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:39.592145 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365fa4-c16d-45a8-b893-9d83e918c836 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:39.592632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365fa4-c16d-45a8-b893-9d83e918c836 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:39.593301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365fa4-c16d-45a8-b893-9d83e918c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:39.618149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-87365fa4-c16d-45a8-b893-9d83e918c836 None None] MFA Rules not processed for user `a3dccb7a525b44c5956bd910067a3653`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:39.621263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-87365fa4-c16d-45a8-b893-9d83e918c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:39.626588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:39.698375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1284/2579] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:39.710623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:39.712046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:39.778815 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:39.798857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad961-3b30-46e7-a02b-b7b465da17c0 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:39.804964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:39.805578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:39.805856 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:39.806136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:39.816348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:39.818287 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:39.828961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1296/2580] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:49.691853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=21 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:49.824480 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=8 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:50.667486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365fa4-c16d-45a8-b893-9d83e918c836 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:50.727572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365fa4-c16d-45a8-b893-9d83e918c836 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:50.731834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:50.732441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:50.732717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:50.733015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:50.734897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:50.807302 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:50.809395 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:50.820177 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1285/2581] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:54.163516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:54.168567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:54.185581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ca759-a45b-458e-bce9-6b7549ea41b8 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:54.191262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:54.191899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:54.192172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:54.192443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] PATH_INFO: `/v3/users/ec329f81679e4ffa83174d621b4440d4` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:54.193732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec329f81679e4ffa83174d621b4440d4)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:54.195648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:54.250818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec329f81679e4ffa83174d621b4440d4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.257759 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec329f81679e4ffa83174d621b4440d4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.267050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec329f81679e4ffa83174d621b4440d4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.267704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec329f81679e4ffa83174d621b4440d4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.280841 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7e1c68f-391c-4ffb-b679-439dc3014c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec329f81679e4ffa83174d621b4440d4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.286920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1297/2582] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:54 2022] DELETE /identity/v3/users/ec329f81679e4ffa83174d621b4440d4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:54.477988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:54.491541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422962a5-0bc9-491d-865f-904c2955d1a2 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:54.557664 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:54.558245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:54.558548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:54.558816 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] PATH_INFO: `/v3/projects/65c70c0408944145bf2c502a23032f9b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:54.560090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c70c0408944145bf2c502a23032f9b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:54.562138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:54.613886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c70c0408944145bf2c502a23032f9b', 'request_id': 'req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.617090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:54.622903 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c70c0408944145bf2c502a23032f9b', 'request_id': 'req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.630878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c70c0408944145bf2c502a23032f9b', 'request_id': 'req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.646477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] The token cache is being invalidate because project 65c70c0408944145bf2c502a23032f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:54.646775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.647407 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4fedea62-c240-4e03-96fd-2b9eabb8ffb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:54.648973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1286/2583] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:54 2022] DELETE /identity/v3/projects/65c70c0408944145bf2c502a23032f9b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:54.654168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803b96-669a-4d55-9d1b-24e40ca68f45 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:54.654452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803b96-669a-4d55-9d1b-24e40ca68f45 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:54.654757 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3803b96-669a-4d55-9d1b-24e40ca68f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:54.676538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e3803b96-669a-4d55-9d1b-24e40ca68f45 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:54.677866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e3803b96-669a-4d55-9d1b-24e40ca68f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:54.743554 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1298/2584] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:54.753065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be749-160a-43dd-b697-95b60a0cb3bf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:54.753363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be749-160a-43dd-b697-95b60a0cb3bf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:54.753631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be749-160a-43dd-b697-95b60a0cb3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:54.774354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2f6be749-160a-43dd-b697-95b60a0cb3bf None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:54.775556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f6be749-160a-43dd-b697-95b60a0cb3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:54.783783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1287/2585] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:54.788482 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3803b96-669a-4d55-9d1b-24e40ca68f45 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:54.799476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3803b96-669a-4d55-9d1b-24e40ca68f45 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:54.804244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:54.804912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:54.805188 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:54.805463 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:54.806114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:11:54.806414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:54.808145 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:54.820213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1299/2586] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:11:54.824830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be749-160a-43dd-b697-95b60a0cb3bf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:54.834122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be749-160a-43dd-b697-95b60a0cb3bf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:54.838852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:54.839483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:54.839817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:54.840153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:54.840828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:54.843082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:54.872907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1288/2587] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:54 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:54.877110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:54.887590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b870f-fe88-4a1d-9d44-84dd11ac799a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:54.947622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:54.948348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:54.948634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:54.949109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:54.949785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:54.951735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:54.960114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:54.979706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1300/2588] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:54 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:54.984349 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:54.995925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca29e1-e1bb-4f52-bb24-72b62688ca35 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.001445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.002051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.002326 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.002598 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.003250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.004897 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.017670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1289/2589] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:55.023949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.039665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22f6c2-5435-4447-a052-7bdef4847361 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.046314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fb4c1-127c-4a47-b1c2-80f68f2dda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.046978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb4c1-127c-4a47-b1c2-80f68f2dda5e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.047242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb4c1-127c-4a47-b1c2-80f68f2dda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.047512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb4c1-127c-4a47-b1c2-80f68f2dda5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.048158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fb4c1-127c-4a47-b1c2-80f68f2dda5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.049781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fb4c1-127c-4a47-b1c2-80f68f2dda5e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.061799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1301/2590] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:55.066287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.076895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e50b3-fb9c-4e2b-b407-43ccda52bdac admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.081467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.082158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.082438 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.082711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] PATH_INFO: `/v3/projects/6c5ac2296018440ea82683253659d0bf/users/50cff5f4dc59451a99fad48db7f36e1a/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.099282 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5ac2296018440ea82683253659d0bf, user_id=50cff5f4dc59451a99fad48db7f36e1a, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.101984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.117860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1290/2591] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:55 2022] PUT /identity/v3/projects/6c5ac2296018440ea82683253659d0bf/users/50cff5f4dc59451a99fad48db7f36e1a/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:55.128975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d002195-4d25-482b-b9fb-20cf22b6e9ec None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.129366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d002195-4d25-482b-b9fb-20cf22b6e9ec None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.129830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d002195-4d25-482b-b9fb-20cf22b6e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.166290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3d002195-4d25-482b-b9fb-20cf22b6e9ec None None] MFA Rules not processed for user `50cff5f4dc59451a99fad48db7f36e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:55.167629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3d002195-4d25-482b-b9fb-20cf22b6e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:55.248645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1302/2592] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:55.255569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.322157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f159c-d90e-45a1-b6f5-84bde0c860ce admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.328099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.328715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.329028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.329295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.329917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.331847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.364831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1291/2593] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:55 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:55.369042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d002195-4d25-482b-b9fb-20cf22b6e9ec None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.380982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d002195-4d25-482b-b9fb-20cf22b6e9ec None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.442634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.443259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.443541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.443881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.444590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.446573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.474451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1303/2594] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:55 2022] POST /identity/v3/users => generated 309 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:55.475714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.486829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240db55-7d7d-4642-bad4-1d431e3140bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.492582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.493264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.493555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.493839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.494519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.496867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.510447 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1292/2595] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:55.515775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.527894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad1a1-480e-4f55-bd1a-969404a8f3bc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.534433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.535242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.535634 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.535863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] PATH_INFO: `/v3/projects/e6280aa4af994b99b6c2cab1f4351992/users/98d5e1cd94ff4cef831599fe59d5a81b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.554149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6280aa4af994b99b6c2cab1f4351992, user_id=98d5e1cd94ff4cef831599fe59d5a81b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.556813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.574372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1304/2596] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:55 2022] PUT /identity/v3/projects/e6280aa4af994b99b6c2cab1f4351992/users/98d5e1cd94ff4cef831599fe59d5a81b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:55.578522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.589190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f366627-cce7-4ea8-a226-b34e8bed2d9f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.649569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:55.662429 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a073f2-4d4f-423e-9539-213c227f199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.663041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a073f2-4d4f-423e-9539-213c227f199f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.663312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a073f2-4d4f-423e-9539-213c227f199f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.663573 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a073f2-4d4f-423e-9539-213c227f199f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.664237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a073f2-4d4f-423e-9539-213c227f199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.665860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a073f2-4d4f-423e-9539-213c227f199f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.676574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1293/2597] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:55.681797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.698423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaddde-0cdf-42a6-aa74-ba430f2efe3c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.707349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.708309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.708680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.709056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] PATH_INFO: `/v3/projects/e6280aa4af994b99b6c2cab1f4351992/users/98d5e1cd94ff4cef831599fe59d5a81b/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.712336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6280aa4af994b99b6c2cab1f4351992, user_id=98d5e1cd94ff4cef831599fe59d5a81b, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.715590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.733433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1305/2598] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:55 2022] PUT /identity/v3/projects/e6280aa4af994b99b6c2cab1f4351992/users/98d5e1cd94ff4cef831599fe59d5a81b/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:55.744223 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23e0da-85d4-4f87-afbe-f7d63187a2bf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.744587 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23e0da-85d4-4f87-afbe-f7d63187a2bf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.744895 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23e0da-85d4-4f87-afbe-f7d63187a2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.775961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8e23e0da-85d4-4f87-afbe-f7d63187a2bf None None] MFA Rules not processed for user `98d5e1cd94ff4cef831599fe59d5a81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:55.777311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8e23e0da-85d4-4f87-afbe-f7d63187a2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:55.851627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1294/2599] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:55.863391 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:55.865590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:55.890424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:55.930694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6031e-1ef1-40c4-9f14-5c33cfefe0d1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:55.934810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f8ee3-3b8d-49ff-8d76-da8a93bec65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:55.935528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f8ee3-3b8d-49ff-8d76-da8a93bec65e service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:55.935810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f8ee3-3b8d-49ff-8d76-da8a93bec65e service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:55.936079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f8ee3-3b8d-49ff-8d76-da8a93bec65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:55.946402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f8ee3-3b8d-49ff-8d76-da8a93bec65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:55.947975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f8ee3-3b8d-49ff-8d76-da8a93bec65e service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:55.958832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1306/2600] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:55 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:56.098791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23e0da-85d4-4f87-afbe-f7d63187a2bf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:56.162309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23e0da-85d4-4f87-afbe-f7d63187a2bf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:56.167025 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:56.167706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:56.167977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:56.168242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] PATH_INFO: `/v3/users/50cff5f4dc59451a99fad48db7f36e1a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:56.169503 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cff5f4dc59451a99fad48db7f36e1a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:56.171430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:56.224993 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cff5f4dc59451a99fad48db7f36e1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.241393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cff5f4dc59451a99fad48db7f36e1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.250283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cff5f4dc59451a99fad48db7f36e1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.251032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cff5f4dc59451a99fad48db7f36e1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.251625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cff5f4dc59451a99fad48db7f36e1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.253338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:56.269969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1295/2601] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:56 2022] DELETE /identity/v3/users/50cff5f4dc59451a99fad48db7f36e1a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:56.274696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:56.275236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:56.275236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:56.296462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:56.297900 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:56.371683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1307/2602] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:56.386774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:56.388823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:56.453660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1d0d-b524-48fc-aa2e-75d98da85b00 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:56.457680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:56.458296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:56.458576 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:56.458848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:56.469394 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:56.470953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:56.481606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1296/2603] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:56.792135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:56.794548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:56.808436 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ce84-11e0-4047-bbf8-a9a3083ec52b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:56.814462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:56.815340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:56.815706 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:56.816041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] PATH_INFO: `/v3/projects/6c5ac2296018440ea82683253659d0bf` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:56.817284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5ac2296018440ea82683253659d0bf)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:56.819216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:56.877752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5ac2296018440ea82683253659d0bf', 'request_id': 'req-c6670eab-c0cb-461c-9724-3d94d0843333'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.883315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5ac2296018440ea82683253659d0bf', 'request_id': 'req-c6670eab-c0cb-461c-9724-3d94d0843333'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.892777 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5ac2296018440ea82683253659d0bf', 'request_id': 'req-c6670eab-c0cb-461c-9724-3d94d0843333'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.906177 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] The token cache is being invalidate because project 6c5ac2296018440ea82683253659d0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:56.906459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.907182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:56.908741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1308/2604] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:56 2022] DELETE /identity/v3/projects/6c5ac2296018440ea82683253659d0bf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:56.913053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:56.924049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59bf89-74a3-4451-8676-424b30de5a5f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:56.986757 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:56.987383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:56.987684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:56.987957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] PATH_INFO: `/v3/users/98d5e1cd94ff4cef831599fe59d5a81b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:56.989316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d5e1cd94ff4cef831599fe59d5a81b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:56.991117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:57.045645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d5e1cd94ff4cef831599fe59d5a81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.057679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d5e1cd94ff4cef831599fe59d5a81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.065021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d5e1cd94ff4cef831599fe59d5a81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.065795 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d5e1cd94ff4cef831599fe59d5a81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.066484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc0f5395-68af-4835-b2f9-0c7ec683b348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d5e1cd94ff4cef831599fe59d5a81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.081667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1297/2605] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:11:56 2022] DELETE /identity/v3/users/98d5e1cd94ff4cef831599fe59d5a81b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:57.368749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:57.370797 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:57.384339 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6670eab-c0cb-461c-9724-3d94d0843333 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:57.438968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:57.466439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:57.467459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.467939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.468064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] PATH_INFO: `/v3/projects/e6280aa4af994b99b6c2cab1f4351992` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.470159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6280aa4af994b99b6c2cab1f4351992)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:57.472087 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:57.530895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6280aa4af994b99b6c2cab1f4351992', 'request_id': 'req-d20082b6-dda7-4118-926d-5a74ffcb3f93'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.536753 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6280aa4af994b99b6c2cab1f4351992', 'request_id': 'req-d20082b6-dda7-4118-926d-5a74ffcb3f93'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.546202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6280aa4af994b99b6c2cab1f4351992', 'request_id': 'req-d20082b6-dda7-4118-926d-5a74ffcb3f93'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.557835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] The token cache is being invalidate because project e6280aa4af994b99b6c2cab1f4351992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:11:57.558127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.558811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d20082b6-dda7-4118-926d-5a74ffcb3f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:11:57.560496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1309/2606] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:11:57 2022] DELETE /identity/v3/projects/e6280aa4af994b99b6c2cab1f4351992 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:57.566376 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.566747 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.567046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.591599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:57.593183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:57.603315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:57.663955 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1298/2607] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:57.673387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c907e78-3155-418c-9ac9-a12a87c88bf7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.673673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c907e78-3155-418c-9ac9-a12a87c88bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.673949 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c907e78-3155-418c-9ac9-a12a87c88bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.752424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:57.753881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:57.816255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb7325-6681-4618-9a03-b3c8a460f7f8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:57.819964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:57.820568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.820869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.821139 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.821252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4c907e78-3155-418c-9ac9-a12a87c88bf7 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:57.822434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4c907e78-3155-418c-9ac9-a12a87c88bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:57.822951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:57.830555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1310/2608] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:57.834919 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c907e78-3155-418c-9ac9-a12a87c88bf7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:57.844776 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c907e78-3155-418c-9ac9-a12a87c88bf7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:57.849383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:57.849973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.850246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.850514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.851150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:11:57.851444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:57.853047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:57.865663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1311/2609] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:11:57.870214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:57.880242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0c4a-299c-4077-9504-061ad48545ca admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:57.884648 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:57.885329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.885605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.885965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.887013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:57.888767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:57.888914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:57.890280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:57.900477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1299/2610] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:11:57.917180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1312/2611] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:57 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:11:57.921866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:57.932283 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241039ec-469b-428d-8885-f0ee0f3103ad service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:57.994709 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:57.995493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.995978 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.996350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.997058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:57.999093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.011654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:58.032678 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1300/2612] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:57 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:58.033964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.049077 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233e6a-3c7d-4dfe-9101-20acd98c77d3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.053818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.054520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.054845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.055193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.055882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.057660 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.068773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1313/2613] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:11:58.073016 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.083649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f723-f513-45c2-96bc-1e5e0a14608e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.088655 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f082574-a3fe-4b41-9bff-043b03ce93b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.089046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f082574-a3fe-4b41-9bff-043b03ce93b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.089415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f082574-a3fe-4b41-9bff-043b03ce93b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.089839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f082574-a3fe-4b41-9bff-043b03ce93b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.090627 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f082574-a3fe-4b41-9bff-043b03ce93b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.092957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f082574-a3fe-4b41-9bff-043b03ce93b4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.103519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1301/2614] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:58.107866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.117967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4cfe6-efca-454c-8796-5d69da676415 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.123022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.123961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.124231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.125309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] PATH_INFO: `/v3/projects/dea85afabeed4f26b8e732e9529c9f8e/users/c736de9da3754b2ca83698b132a36d1c/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.141943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea85afabeed4f26b8e732e9529c9f8e, user_id=c736de9da3754b2ca83698b132a36d1c, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.144630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.157710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1314/2615] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:58 2022] PUT /identity/v3/projects/dea85afabeed4f26b8e732e9529c9f8e/users/c736de9da3754b2ca83698b132a36d1c/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:58.168777 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9e51-4d94-461c-b56a-581b82c36c09 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.169092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9e51-4d94-461c-b56a-581b82c36c09 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.169363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9e51-4d94-461c-b56a-581b82c36c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.199541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-162e9e51-4d94-461c-b56a-581b82c36c09 None None] MFA Rules not processed for user `c736de9da3754b2ca83698b132a36d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:58.200778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-162e9e51-4d94-461c-b56a-581b82c36c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:58.286488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1302/2616] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:58.291033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.358000 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab4ce-9aee-4260-9bfd-7af1d41352fd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.362809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.363489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.363692 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.363963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.364589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.366545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.371910 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:58.402112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1315/2617] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:11:58 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:58.406500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9e51-4d94-461c-b56a-581b82c36c09 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.418347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9e51-4d94-461c-b56a-581b82c36c09 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.482739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.483265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.483541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.483845 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.484427 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.486439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.509479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1303/2618] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:11:58 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:11:58.513672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.526004 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605e42e-de21-4154-91ce-ce3b84ea206d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.531297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.531901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.532180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.532443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.533110 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.534701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.545869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1316/2619] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:58.550156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.561971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fc2b7-b44b-49d9-b038-073c4170bc8b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.567548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.568216 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.568630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.568936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] PATH_INFO: `/v3/projects/0454fdebb4844f498a0eb63f06128a47/users/d362c5d4c1e444f58e5e795e9047f75a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.585305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0454fdebb4844f498a0eb63f06128a47, user_id=d362c5d4c1e444f58e5e795e9047f75a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.588076 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.606338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1304/2620] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:58 2022] PUT /identity/v3/projects/0454fdebb4844f498a0eb63f06128a47/users/d362c5d4c1e444f58e5e795e9047f75a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:11:58.610362 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.622165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233568e2-0691-4fe2-8f71-cc77fa17aa55 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.686340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b720-e3d7-4b85-beba-9057bd34f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.687396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b720-e3d7-4b85-beba-9057bd34f724 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.687396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b720-e3d7-4b85-beba-9057bd34f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.687647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b720-e3d7-4b85-beba-9057bd34f724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.688141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b720-e3d7-4b85-beba-9057bd34f724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.689752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b720-e3d7-4b85-beba-9057bd34f724 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.700665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1317/2621] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:11:58.705393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.717015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03321361-a9c2-4c89-a265-f63a22062a06 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.722392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.723067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.723352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.723619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] PATH_INFO: `/v3/projects/0454fdebb4844f498a0eb63f06128a47/users/d362c5d4c1e444f58e5e795e9047f75a/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.726255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0454fdebb4844f498a0eb63f06128a47, user_id=d362c5d4c1e444f58e5e795e9047f75a, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.729373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.741512 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1305/2622] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:11:58 2022] PUT /identity/v3/projects/0454fdebb4844f498a0eb63f06128a47/users/d362c5d4c1e444f58e5e795e9047f75a/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:11:58.755623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7dfc-d2fe-4e93-bba0-719708e45cee None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.755935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7dfc-d2fe-4e93-bba0-719708e45cee None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.756376 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7dfc-d2fe-4e93-bba0-719708e45cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.790294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d46e7dfc-d2fe-4e93-bba0-719708e45cee None None] MFA Rules not processed for user `d362c5d4c1e444f58e5e795e9047f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:58.791594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d46e7dfc-d2fe-4e93-bba0-719708e45cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:58.862422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1318/2623] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:58.874528 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.876490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:58.907423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:58.941658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459060b-3655-43c1-97b4-818b6fab099f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.945480 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.946070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.946347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.946621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.956552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.958049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.968565 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1306/2624] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:59.034435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e7dfc-d2fe-4e93-bba0-719708e45cee None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:59.045105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e7dfc-d2fe-4e93-bba0-719708e45cee None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:59.050319 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24cdb-c201-4a7d-b877-788ef97ddb0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:59.051127 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24cdb-c201-4a7d-b877-788ef97ddb0a service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:59.051472 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24cdb-c201-4a7d-b877-788ef97ddb0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:59.051873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24cdb-c201-4a7d-b877-788ef97ddb0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:59.109353 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:59.114622 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd24cdb-c201-4a7d-b877-788ef97ddb0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:59.117256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd24cdb-c201-4a7d-b877-788ef97ddb0a service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:59.130724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1319/2625] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:02.591301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:02.659941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b236eb-a392-47fd-8d61-f9fb11050f9c service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:02.664832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:02.665553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:02.665831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:02.666117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] PATH_INFO: `/v3/users/c736de9da3754b2ca83698b132a36d1c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:02.667324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c736de9da3754b2ca83698b132a36d1c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:02.669586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:02.721269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c736de9da3754b2ca83698b132a36d1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:02.733807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c736de9da3754b2ca83698b132a36d1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:02.740706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c736de9da3754b2ca83698b132a36d1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:02.741452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c736de9da3754b2ca83698b132a36d1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:02.742066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c736de9da3754b2ca83698b132a36d1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:02.759704 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1307/2626] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:02 2022] DELETE /identity/v3/users/c736de9da3754b2ca83698b132a36d1c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:02.765195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:02.765939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:02.765939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:02.786732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:02.787960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:02.852394 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1320/2627] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:02.865670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:02.867699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:02.934654 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:02.941264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d88b-5c54-4d11-93b0-539f5cf6eeaa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:02.947927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:02.949255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:02.949857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:02.950329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:02.961318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:02.962748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:02.974294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1308/2628] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:03.268250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:03.269732 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:03.282486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0548-d267-4a62-b7d0-7013889835ff None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:03.288401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:03.289086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:03.289358 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:03.289616 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] PATH_INFO: `/v3/projects/dea85afabeed4f26b8e732e9529c9f8e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:03.290803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea85afabeed4f26b8e732e9529c9f8e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:03.292700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:03.355901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea85afabeed4f26b8e732e9529c9f8e', 'request_id': 'req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.362552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea85afabeed4f26b8e732e9529c9f8e', 'request_id': 'req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.374380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea85afabeed4f26b8e732e9529c9f8e', 'request_id': 'req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.390317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] The token cache is being invalidate because project dea85afabeed4f26b8e732e9529c9f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:03.390653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.391359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.393333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1321/2629] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:03 2022] DELETE /identity/v3/projects/dea85afabeed4f26b8e732e9529c9f8e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:03.397690 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:03.408314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f31050-abea-4342-86c9-20b971eaa248 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:03.483043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:03.483779 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:03.484053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:03.484354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] PATH_INFO: `/v3/users/d362c5d4c1e444f58e5e795e9047f75a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:03.485563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d362c5d4c1e444f58e5e795e9047f75a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:03.487538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:03.542673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd362c5d4c1e444f58e5e795e9047f75a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.556173 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd362c5d4c1e444f58e5e795e9047f75a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.564702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd362c5d4c1e444f58e5e795e9047f75a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.565549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd362c5d4c1e444f58e5e795e9047f75a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.566265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-45cef13f-e442-4c79-93f7-2f917f5b261e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd362c5d4c1e444f58e5e795e9047f75a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:03.580412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1309/2630] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:03 2022] DELETE /identity/v3/users/d362c5d4c1e444f58e5e795e9047f75a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:03.891170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:03.892719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:03.907718 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc713e6-0fa2-4e86-8499-ca2d1bac655c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:03.974572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:03.975209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:03.975485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:03.975750 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] PATH_INFO: `/v3/projects/0454fdebb4844f498a0eb63f06128a47` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:03.976907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0454fdebb4844f498a0eb63f06128a47)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:03.978835 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.000151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:04.029605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0454fdebb4844f498a0eb63f06128a47', 'request_id': 'req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:04.035274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0454fdebb4844f498a0eb63f06128a47', 'request_id': 'req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:04.043662 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0454fdebb4844f498a0eb63f06128a47', 'request_id': 'req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:04.058507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] The token cache is being invalidate because project 0454fdebb4844f498a0eb63f06128a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:04.058898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:04.059822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cffe6dfa-023a-40d8-8ae2-bc826a7abd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:04.061683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1322/2631] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:03 2022] DELETE /identity/v3/projects/0454fdebb4844f498a0eb63f06128a47 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:04.066963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb768b-065f-404e-941b-c3ffec5dacf8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.067473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb768b-065f-404e-941b-c3ffec5dacf8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.067592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb768b-065f-404e-941b-c3ffec5dacf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.088702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-21cb768b-065f-404e-941b-c3ffec5dacf8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:04.090272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-21cb768b-065f-404e-941b-c3ffec5dacf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:04.164984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1310/2632] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:04.177349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603b206-d4a5-4b93-9237-f0292ac09e50 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.177740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603b206-d4a5-4b93-9237-f0292ac09e50 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.178008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603b206-d4a5-4b93-9237-f0292ac09e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.202582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2603b206-d4a5-4b93-9237-f0292ac09e50 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:04.203863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2603b206-d4a5-4b93-9237-f0292ac09e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:04.211763 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1323/2633] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:04.216650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb768b-065f-404e-941b-c3ffec5dacf8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.228102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb768b-065f-404e-941b-c3ffec5dacf8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.234748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.235347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.235620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.235878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.236568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:04.236907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.238547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.241396 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:04.257340 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1311/2634] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:12:04.259657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603b206-d4a5-4b93-9237-f0292ac09e50 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.279260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603b206-d4a5-4b93-9237-f0292ac09e50 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.285352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.285977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.286245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.286505 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.287174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.289114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.326046 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1324/2635] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:04.331371 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.344481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d53e1-1d1d-46c3-ba80-8a137f0616bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.403500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.404113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.404386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.404656 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.405316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.407247 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.431278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1312/2636] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:04.436278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.451224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a23a-0ecb-4604-82b1-2a6b6099b199 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.457297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.457929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.458202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.458465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.459106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.460704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.471537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1325/2637] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:04.475803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.486515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58092a7-71d6-4202-a0b9-d10a676f19ae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.492159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5eeeb-c5d4-4503-b117-e7094a6404e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.492752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5eeeb-c5d4-4503-b117-e7094a6404e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.493049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5eeeb-c5d4-4503-b117-e7094a6404e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.493311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5eeeb-c5d4-4503-b117-e7094a6404e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.493950 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5eeeb-c5d4-4503-b117-e7094a6404e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.495547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5eeeb-c5d4-4503-b117-e7094a6404e1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.507203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1313/2638] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:04.511641 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.522181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9bd9f-2e03-4fa0-a248-a9e8aa8fa578 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.527895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.528561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.528857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.529135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] PATH_INFO: `/v3/projects/d9f55efcb0f24ca7a868ccafe68ca452/users/5c352e49cb6b4ac2aa76d57cfe809ca8/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.544792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f55efcb0f24ca7a868ccafe68ca452, user_id=5c352e49cb6b4ac2aa76d57cfe809ca8, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.547455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.567396 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1326/2639] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:04 2022] PUT /identity/v3/projects/d9f55efcb0f24ca7a868ccafe68ca452/users/5c352e49cb6b4ac2aa76d57cfe809ca8/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:04.580891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d43b-5bd7-4d32-b63d-0ef80aa930f1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.581166 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d43b-5bd7-4d32-b63d-0ef80aa930f1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.581423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d43b-5bd7-4d32-b63d-0ef80aa930f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.612091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9433d43b-5bd7-4d32-b63d-0ef80aa930f1 None None] MFA Rules not processed for user `5c352e49cb6b4ac2aa76d57cfe809ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:04.613364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9433d43b-5bd7-4d32-b63d-0ef80aa930f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:04.680525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1314/2640] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:04.685611 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.749570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bfb80-80c2-466d-b42c-08362a7fb220 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.754977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.755624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.755883 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.756277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.756950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.758873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.789558 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1327/2641] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:04.793796 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d43b-5bd7-4d32-b63d-0ef80aa930f1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.805488 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d43b-5bd7-4d32-b63d-0ef80aa930f1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.868311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.869241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.869693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.869961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.870588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.872844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.883312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:04.899101 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1315/2642] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:04.900385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.911106 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdaf8d-51f5-4ef7-b4dd-24ed780b0e92 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.915843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.916446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.916745 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.917040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.917678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.919298 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.931452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1328/2643] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:04.936083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.947859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3cc0e-5435-417a-80db-a306a99a8a06 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.954154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391567f-2aa4-4c7c-9271-f23e86111087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.954817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391567f-2aa4-4c7c-9271-f23e86111087 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.955018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391567f-2aa4-4c7c-9271-f23e86111087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.955335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391567f-2aa4-4c7c-9271-f23e86111087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.956093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391567f-2aa4-4c7c-9271-f23e86111087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.957756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391567f-2aa4-4c7c-9271-f23e86111087 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.969484 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1316/2644] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:04.974710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.984897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d13ac-2e9a-4f65-9a27-0158d9620a31 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.991697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.992450 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.992876 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.993221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] PATH_INFO: `/v3/projects/6bfcd9aafbfa4cbf98936f6539882e8f/users/61e05c35dc124900962464f1792baed0/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.010751 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfcd9aafbfa4cbf98936f6539882e8f, user_id=61e05c35dc124900962464f1792baed0, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.014071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.016421 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:05.034299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1329/2645] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:04 2022] PUT /identity/v3/projects/6bfcd9aafbfa4cbf98936f6539882e8f/users/61e05c35dc124900962464f1792baed0/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:05.046106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a478-e7b6-44a4-9ac3-78ec2dd4d5ed None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.046463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a478-e7b6-44a4-9ac3-78ec2dd4d5ed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.046643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a478-e7b6-44a4-9ac3-78ec2dd4d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.077924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d353a478-e7b6-44a4-9ac3-78ec2dd4d5ed None None] MFA Rules not processed for user `61e05c35dc124900962464f1792baed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:05.079437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d353a478-e7b6-44a4-9ac3-78ec2dd4d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:05.150717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1317/2646] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:05.155367 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:05.220024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221dd10-6d66-42d0-89ab-1e93c87ad1bd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:05.224877 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:05.225624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.226095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.226552 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.227305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.229422 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.257993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1330/2647] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:05 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:05.263240 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a478-e7b6-44a4-9ac3-78ec2dd4d5ed None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:05.280724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a478-e7b6-44a4-9ac3-78ec2dd4d5ed None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:05.346278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:05.347205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.347581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.347945 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.348691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.350758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.375818 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1318/2648] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:05 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:05.379848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:05.392093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759a75-47c3-4366-97d4-14ef72ccf4eb admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:05.397388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:05.397998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.398272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.398539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.399196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.401457 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.419730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1331/2649] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:05.421046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:05.431854 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebbe9f-a7c8-460a-830c-e85337366ada admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:05.436887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:05.437559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.437840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.438111 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] PATH_INFO: `/v3/projects/ab0301dfcb8e436db801ae2ba0771a7a/users/ca9fa616fbcb40db91046c3ca7d64476/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.456010 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0301dfcb8e436db801ae2ba0771a7a, user_id=ca9fa616fbcb40db91046c3ca7d64476, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.460004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.477648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1319/2650] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:05 2022] PUT /identity/v3/projects/ab0301dfcb8e436db801ae2ba0771a7a/users/ca9fa616fbcb40db91046c3ca7d64476/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:05.482676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:05.492794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce0a9-2a26-4f22-972f-e1dd932959d9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:05.561884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37af2b-d712-49a4-9ea3-79f4141bd5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:05.562509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37af2b-d712-49a4-9ea3-79f4141bd5fd admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.562783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37af2b-d712-49a4-9ea3-79f4141bd5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.563048 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37af2b-d712-49a4-9ea3-79f4141bd5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.563697 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37af2b-d712-49a4-9ea3-79f4141bd5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.565380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37af2b-d712-49a4-9ea3-79f4141bd5fd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.577561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1332/2651] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:05.582419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:05.596211 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0e487-d50b-4493-8b23-ca8a1892d501 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:05.602063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:05.602790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.603075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.603261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] PATH_INFO: `/v3/projects/ab0301dfcb8e436db801ae2ba0771a7a/users/ca9fa616fbcb40db91046c3ca7d64476/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.605523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0301dfcb8e436db801ae2ba0771a7a, user_id=ca9fa616fbcb40db91046c3ca7d64476, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.608280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.619836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1320/2652] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:05 2022] PUT /identity/v3/projects/ab0301dfcb8e436db801ae2ba0771a7a/users/ca9fa616fbcb40db91046c3ca7d64476/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:05.631597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032d1ea-edd5-494a-b5c7-ba39f75438d5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.631924 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032d1ea-edd5-494a-b5c7-ba39f75438d5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.632193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032d1ea-edd5-494a-b5c7-ba39f75438d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.664384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c032d1ea-edd5-494a-b5c7-ba39f75438d5 None None] MFA Rules not processed for user `ca9fa616fbcb40db91046c3ca7d64476`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:05.665733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c032d1ea-edd5-494a-b5c7-ba39f75438d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:05.719327 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:05.746823 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1333/2653] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:05.759165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:05.761187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:05.790644 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:05.826079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716345f-605b-4579-9d34-1fa92750d9aa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:05.830206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:05.830819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:05.831092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:05.831360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:05.841358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:05.843154 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:05.852827 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1321/2654] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:06.443460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032d1ea-edd5-494a-b5c7-ba39f75438d5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:06.454435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032d1ea-edd5-494a-b5c7-ba39f75438d5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:06.458418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:06.459021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:06.459300 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:06.459623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:06.519895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:06.521426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:06.530475 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1334/2655] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:10.653914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:10.663485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f751-5856-4efc-82d0-eb95ab66c6dd service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:10.667556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266c9e8-c06b-4f3d-92ee-ebe20596950b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:10.668147 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c9e8-c06b-4f3d-92ee-ebe20596950b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:10.668424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c9e8-c06b-4f3d-92ee-ebe20596950b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:10.668724 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266c9e8-c06b-4f3d-92ee-ebe20596950b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:10.729311 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266c9e8-c06b-4f3d-92ee-ebe20596950b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:10.730760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266c9e8-c06b-4f3d-92ee-ebe20596950b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:10.740037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1322/2656] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:12.928090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:12.996922 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f740aa-eb3a-4e68-ba4e-dbecced610dc service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:13.001987 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:13.002626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:13.002908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:13.003167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] PATH_INFO: `/v3/users/5c352e49cb6b4ac2aa76d57cfe809ca8` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:13.004291 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c352e49cb6b4ac2aa76d57cfe809ca8)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:13.006218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:13.057330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c352e49cb6b4ac2aa76d57cfe809ca8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.064948 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c352e49cb6b4ac2aa76d57cfe809ca8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.074408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c352e49cb6b4ac2aa76d57cfe809ca8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.075071 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c352e49cb6b4ac2aa76d57cfe809ca8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.088231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c352e49cb6b4ac2aa76d57cfe809ca8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.094951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1335/2657] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:12 2022] DELETE /identity/v3/users/5c352e49cb6b4ac2aa76d57cfe809ca8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:13.099487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:13.099973 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:13.100099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:13.119225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:13.120575 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:13.182123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1323/2658] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:13.192441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:13.194132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:13.205509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:13.258251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4683e-de64-4ae9-9915-2fed63dd308c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:13.263082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:13.263683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:13.263959 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:13.264223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:13.273809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:13.275310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:13.285710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1336/2659] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:13.565865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:13.567683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:13.581527 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b473c-d150-4995-b43d-9cd9f3558586 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:13.587649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:13.588304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:13.588660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:13.589239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] PATH_INFO: `/v3/projects/d9f55efcb0f24ca7a868ccafe68ca452` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:13.591202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f55efcb0f24ca7a868ccafe68ca452)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:13.593783 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:13.641801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f55efcb0f24ca7a868ccafe68ca452', 'request_id': 'req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.648172 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f55efcb0f24ca7a868ccafe68ca452', 'request_id': 'req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.652661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:13.654462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f55efcb0f24ca7a868ccafe68ca452', 'request_id': 'req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.668737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] The token cache is being invalidate because project d9f55efcb0f24ca7a868ccafe68ca452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:13.669052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.669661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.671229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1324/2660] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:13 2022] DELETE /identity/v3/projects/d9f55efcb0f24ca7a868ccafe68ca452 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:13.675350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:13.684813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264b288-a4ad-4762-b575-b2133592834b service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:13.742887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:13.743513 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:13.743787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:13.744052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] PATH_INFO: `/v3/users/61e05c35dc124900962464f1792baed0` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:13.745249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e05c35dc124900962464f1792baed0)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:13.747152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:13.795792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e05c35dc124900962464f1792baed0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.802635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e05c35dc124900962464f1792baed0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.812843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e05c35dc124900962464f1792baed0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.813547 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e05c35dc124900962464f1792baed0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.825162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e05c35dc124900962464f1792baed0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:13.831092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1337/2661] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:13 2022] DELETE /identity/v3/users/61e05c35dc124900962464f1792baed0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:14.128515 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:14.130900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:14.145035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e720bcd-fc8f-4e78-9bd2-0894a815f8ec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:14.212819 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:14.213524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:14.213806 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:14.214079 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] PATH_INFO: `/v3/projects/6bfcd9aafbfa4cbf98936f6539882e8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:14.215369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfcd9aafbfa4cbf98936f6539882e8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:14.217586 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:14.273453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfcd9aafbfa4cbf98936f6539882e8f', 'request_id': 'req-287845a4-5048-499c-9535-f758b0e9dbe9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.280625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfcd9aafbfa4cbf98936f6539882e8f', 'request_id': 'req-287845a4-5048-499c-9535-f758b0e9dbe9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.289175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfcd9aafbfa4cbf98936f6539882e8f', 'request_id': 'req-287845a4-5048-499c-9535-f758b0e9dbe9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.305041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] The token cache is being invalidate because project 6bfcd9aafbfa4cbf98936f6539882e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:14.305227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.305902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.307400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1325/2662] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:14 2022] DELETE /identity/v3/projects/6bfcd9aafbfa4cbf98936f6539882e8f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:14.311637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:14.313181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:14.325848 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c103-0a04-4729-81d9-8c70ec0af387 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:14.353632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:14.390590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:14.391429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:14.391601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:14.394827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] PATH_INFO: `/v3/users/ca9fa616fbcb40db91046c3ca7d64476` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:14.394827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9fa616fbcb40db91046c3ca7d64476)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:14.395129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:14.447447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9fa616fbcb40db91046c3ca7d64476'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.454699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9fa616fbcb40db91046c3ca7d64476'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.463379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9fa616fbcb40db91046c3ca7d64476'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.464198 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9fa616fbcb40db91046c3ca7d64476'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.477838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9d3eb25e-f3ba-4968-a86a-c6ade354376b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9fa616fbcb40db91046c3ca7d64476'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.484099 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1338/2663] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:14 2022] DELETE /identity/v3/users/ca9fa616fbcb40db91046c3ca7d64476 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:14.774980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:14.776879 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:14.790829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287845a4-5048-499c-9535-f758b0e9dbe9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:14.855060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:14.855679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:14.855953 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:14.856232 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] PATH_INFO: `/v3/projects/ab0301dfcb8e436db801ae2ba0771a7a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:14.857409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0301dfcb8e436db801ae2ba0771a7a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:14.859808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:14.885009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:14.910684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0301dfcb8e436db801ae2ba0771a7a', 'request_id': 'req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.916976 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0301dfcb8e436db801ae2ba0771a7a', 'request_id': 'req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.923102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0301dfcb8e436db801ae2ba0771a7a', 'request_id': 'req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.936863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] The token cache is being invalidate because project ab0301dfcb8e436db801ae2ba0771a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:14.937315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.937926 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1236d31a-a5b5-4ce2-8d7d-65f94afe93db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:14.939425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1326/2664] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:14 2022] DELETE /identity/v3/projects/ab0301dfcb8e436db801ae2ba0771a7a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:14.945486 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209418f2-1c0d-4ef3-b935-ff281fa49761 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:14.945799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209418f2-1c0d-4ef3-b935-ff281fa49761 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:14.946079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209418f2-1c0d-4ef3-b935-ff281fa49761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:14.968969 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-209418f2-1c0d-4ef3-b935-ff281fa49761 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:14.970337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-209418f2-1c0d-4ef3-b935-ff281fa49761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:15.037018 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1339/2665] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:15.047356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673133f-6a67-442d-960c-50346767449e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.047632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673133f-6a67-442d-960c-50346767449e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.047932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673133f-6a67-442d-960c-50346767449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.070741 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b673133f-6a67-442d-960c-50346767449e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:15.072004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b673133f-6a67-442d-960c-50346767449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:15.081134 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1327/2666] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:15.085489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209418f2-1c0d-4ef3-b935-ff281fa49761 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.095847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209418f2-1c0d-4ef3-b935-ff281fa49761 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.100933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.101524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.101793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.102054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.102688 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:15.103230 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.104521 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.116420 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1340/2667] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:15.121118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673133f-6a67-442d-960c-50346767449e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.131964 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673133f-6a67-442d-960c-50346767449e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.138940 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.139604 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.139871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.140165 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.140831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.142786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.174305 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1328/2668] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:15 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:15.178659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.189957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cc5a0-b9bb-4d25-90db-d727cdc237bd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.226308 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:15.255402 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.256013 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.256292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.256563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.257224 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.259092 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.288639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1341/2669] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:15 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:15.293572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.311203 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426ce4-9cd3-42bd-846c-c3e2586e8bdf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.316963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.317559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.317832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.318097 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.318734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.320318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.330916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1329/2670] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:15.335006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.346606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25de1e-6abf-48ae-bc01-be38aef87cb8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.352104 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb730dc7-de75-4171-a63f-db3e1737b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.352716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb730dc7-de75-4171-a63f-db3e1737b690 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.353035 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb730dc7-de75-4171-a63f-db3e1737b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.353305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb730dc7-de75-4171-a63f-db3e1737b690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.353956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb730dc7-de75-4171-a63f-db3e1737b690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.355536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb730dc7-de75-4171-a63f-db3e1737b690 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.366368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1342/2671] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:15.372263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.382957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b1f42-5555-4c0b-8b4b-e3f33de15461 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.388641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.389492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.389935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.390419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] PATH_INFO: `/v3/projects/05f4130019f041999944b17032d3d393/users/5b3c1ca9c92b417e8baac958fe80faee/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.405985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f4130019f041999944b17032d3d393, user_id=5b3c1ca9c92b417e8baac958fe80faee, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.408620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.423522 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1330/2672] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:15 2022] PUT /identity/v3/projects/05f4130019f041999944b17032d3d393/users/5b3c1ca9c92b417e8baac958fe80faee/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:15.434964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f911f-5f3d-4987-a3ac-2c801b512afe None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.435256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f911f-5f3d-4987-a3ac-2c801b512afe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.435525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f911f-5f3d-4987-a3ac-2c801b512afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.464080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7f1f911f-5f3d-4987-a3ac-2c801b512afe None None] MFA Rules not processed for user `5b3c1ca9c92b417e8baac958fe80faee`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:15.465322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7f1f911f-5f3d-4987-a3ac-2c801b512afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:15.540452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1343/2673] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:15.545133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.619142 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c281c9-3df2-4def-810d-88884d7a5d5b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.624345 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.625017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.625295 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.625542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.626180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.628086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.658267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1331/2674] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:15 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:15.662563 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f911f-5f3d-4987-a3ac-2c801b512afe None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.674161 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f911f-5f3d-4987-a3ac-2c801b512afe None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.735769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.736418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.736694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.736990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.737624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.739557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.766370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1344/2675] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:15 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:15.772233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.782130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1169-040e-441e-896a-d5d1a0369949 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.787351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.789084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.789084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.789084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.789389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.790937 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.803242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1332/2676] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:15.807514 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.818102 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f69ed-1b25-4952-9c93-3a8d966ecbd1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.823068 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.823737 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.824017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.824288 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] PATH_INFO: `/v3/projects/8f6f23e4874349bcab8f294d6b76844d/users/c10fb15bb7f94037bad1d7f490ec68a0/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.844491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6f23e4874349bcab8f294d6b76844d, user_id=c10fb15bb7f94037bad1d7f490ec68a0, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.847252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.862930 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1345/2677] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:15 2022] PUT /identity/v3/projects/8f6f23e4874349bcab8f294d6b76844d/users/c10fb15bb7f94037bad1d7f490ec68a0/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:15.867352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.879546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84859-3858-4a58-b7a2-fb2e03910a60 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.900381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:15.944807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0b23e-72b8-4721-89a7-318f1e4d4193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.945437 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0b23e-72b8-4721-89a7-318f1e4d4193 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.945715 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0b23e-72b8-4721-89a7-318f1e4d4193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.945981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0b23e-72b8-4721-89a7-318f1e4d4193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.946647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0b23e-72b8-4721-89a7-318f1e4d4193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.948222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0b23e-72b8-4721-89a7-318f1e4d4193 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.958665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1333/2678] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:15.964769 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:15.975710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943961-79e1-4733-ad90-2088fc84fe8b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:15.980417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:15.981171 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.981460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.981803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] PATH_INFO: `/v3/projects/8f6f23e4874349bcab8f294d6b76844d/users/c10fb15bb7f94037bad1d7f490ec68a0/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.983986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6f23e4874349bcab8f294d6b76844d, user_id=c10fb15bb7f94037bad1d7f490ec68a0, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:15.986601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:15.989869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:15.999950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1346/2679] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:15 2022] PUT /identity/v3/projects/8f6f23e4874349bcab8f294d6b76844d/users/c10fb15bb7f94037bad1d7f490ec68a0/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:16.012198 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:16.012513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:16.012925 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:16.043241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] MFA Rules not processed for user `c10fb15bb7f94037bad1d7f490ec68a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:16.044389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:16.117934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1334/2680] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:16.129966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:16.131921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:16.193136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757efa6-862e-4a21-a12e-a7b1af3623f7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:16.197253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:16.197857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:16.198129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:16.198393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:16.208183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:16.209655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:16.219765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1347/2681] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:16.280840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:16.282363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:16.295163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35331a09-a20e-495f-abaf-65fa1c510b2b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:16.299774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:16.300381 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:16.300642 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:16.300954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:16.362415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:16.363887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:16.373806 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1335/2682] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:18.069493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:18.071056 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:18.145120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17404f-06d3-41bc-a1af-f50c3d1b39b4 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:18.149725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:18.150361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:18.150639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:18.150911 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] PATH_INFO: `/v3/users/a3dccb7a525b44c5956bd910067a3653` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:18.152032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3dccb7a525b44c5956bd910067a3653)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:18.153982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:18.205199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3dccb7a525b44c5956bd910067a3653'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.212469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3dccb7a525b44c5956bd910067a3653'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.221133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3dccb7a525b44c5956bd910067a3653'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.221748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3dccb7a525b44c5956bd910067a3653'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.234426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3dccb7a525b44c5956bd910067a3653'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.240364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1348/2683] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:18 2022] DELETE /identity/v3/users/a3dccb7a525b44c5956bd910067a3653 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:18.429194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:18.444296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8ed6-e78b-4c4b-b4d6-5ca8b5c074ad service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:18.492660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:18.515987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:18.516698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:18.517152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:18.517253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] PATH_INFO: `/v3/projects/ef4bf7c6e4064df180d753b9f67b0b06` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:18.518630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4bf7c6e4064df180d753b9f67b0b06)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:18.520713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:18.585701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4bf7c6e4064df180d753b9f67b0b06', 'request_id': 'req-6385a3ba-e120-486e-bd65-0e68e27489ae'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.594414 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4bf7c6e4064df180d753b9f67b0b06', 'request_id': 'req-6385a3ba-e120-486e-bd65-0e68e27489ae'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.600157 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4bf7c6e4064df180d753b9f67b0b06', 'request_id': 'req-6385a3ba-e120-486e-bd65-0e68e27489ae'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.614491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] The token cache is being invalidate because project ef4bf7c6e4064df180d753b9f67b0b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:18.614912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.615768 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.617533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1336/2684] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:18 2022] DELETE /identity/v3/projects/ef4bf7c6e4064df180d753b9f67b0b06 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:18.621792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:18.623317 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:18.636852 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671c8ac-a8df-40ad-bdc2-99634067a4f7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:18.651209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:18.708983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:18.709580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:18.709967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:18.710465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] PATH_INFO: `/v3/users/103acc8e6fee488382b80ead1f89c5a3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:18.711617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103acc8e6fee488382b80ead1f89c5a3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:18.713533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:18.778606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103acc8e6fee488382b80ead1f89c5a3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.785993 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103acc8e6fee488382b80ead1f89c5a3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.794469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103acc8e6fee488382b80ead1f89c5a3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.795148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103acc8e6fee488382b80ead1f89c5a3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.809566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7e3f9420-a7c2-497f-b3ee-80fc8be03b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103acc8e6fee488382b80ead1f89c5a3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:18.819015 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1349/2685] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:18 2022] DELETE /identity/v3/users/103acc8e6fee488382b80ead1f89c5a3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:19.007740 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.009424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:19.025161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385a3ba-e120-486e-bd65-0e68e27489ae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.085733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.086359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.086649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.086914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] PATH_INFO: `/v3/projects/d322f450d7a9472bb7548c9cb06b9ed5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.088024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d322f450d7a9472bb7548c9cb06b9ed5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.089963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.138238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd322f450d7a9472bb7548c9cb06b9ed5', 'request_id': 'req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.144432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd322f450d7a9472bb7548c9cb06b9ed5', 'request_id': 'req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.150942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd322f450d7a9472bb7548c9cb06b9ed5', 'request_id': 'req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.162006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:19.166649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] The token cache is being invalidate because project d322f450d7a9472bb7548c9cb06b9ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:19.167098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.167820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-56ae7f37-4d63-4a7f-aec8-90b1475d53a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.169946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1337/2686] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:19 2022] DELETE /identity/v3/projects/d322f450d7a9472bb7548c9cb06b9ed5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:19.175064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420347-f4f7-43cf-89b3-b56647d79b25 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.175599 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420347-f4f7-43cf-89b3-b56647d79b25 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.175704 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420347-f4f7-43cf-89b3-b56647d79b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.196333 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-61420347-f4f7-43cf-89b3-b56647d79b25 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:19.197565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-61420347-f4f7-43cf-89b3-b56647d79b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:19.266126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1350/2687] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:19.274265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b454ec-dbe9-44c8-8180-c2db18ae7051 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.274569 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b454ec-dbe9-44c8-8180-c2db18ae7051 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.274843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b454ec-dbe9-44c8-8180-c2db18ae7051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.297787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f5b454ec-dbe9-44c8-8180-c2db18ae7051 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:19.299039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f5b454ec-dbe9-44c8-8180-c2db18ae7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:19.308370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1338/2688] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:19.313132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420347-f4f7-43cf-89b3-b56647d79b25 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.324708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420347-f4f7-43cf-89b3-b56647d79b25 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.331595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.332221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.332494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.332760 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.333483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:19.333781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.335383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.350163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1351/2689] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:19.354985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b454ec-dbe9-44c8-8180-c2db18ae7051 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.365237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b454ec-dbe9-44c8-8180-c2db18ae7051 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.370375 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.370957 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.371238 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.371500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.372141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.374496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.406108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1339/2690] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:19 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:19.410606 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.421631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837269c5-bf22-4810-8a25-de69ecbd78ca admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.445207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:19.486244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.486850 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.487108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.487372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.488006 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.489963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.515065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1352/2691] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:19 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:19.519543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.530291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb769e4-fbc5-4627-a4ca-d84f47f5af55 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.536222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.536829 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.537117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.537380 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.538024 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.539634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.551844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1340/2692] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:19.557997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.573913 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174da97-4b18-4122-9cc7-75409ec8e1d6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.581124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de240ea-be3d-4392-a513-7aea2b003349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.581727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de240ea-be3d-4392-a513-7aea2b003349 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.581995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de240ea-be3d-4392-a513-7aea2b003349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.582283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de240ea-be3d-4392-a513-7aea2b003349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.582935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de240ea-be3d-4392-a513-7aea2b003349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.585005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de240ea-be3d-4392-a513-7aea2b003349 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.598578 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1353/2693] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:19.603832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.615908 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a716e1-b0bd-450f-8ba0-6afd68c4f74e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.621713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.622369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.622641 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.622906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] PATH_INFO: `/v3/projects/b981ed958724481281f6f649a8ccc601/users/20280490bbc34c059ae271ae5ac0f570/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.638536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b981ed958724481281f6f649a8ccc601, user_id=20280490bbc34c059ae271ae5ac0f570, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.641280 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.655916 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1341/2694] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:19 2022] PUT /identity/v3/projects/b981ed958724481281f6f649a8ccc601/users/20280490bbc34c059ae271ae5ac0f570/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:19.666468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.666749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.667017 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.698494 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] MFA Rules not processed for user `20280490bbc34c059ae271ae5ac0f570`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:19.699804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:19.763988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.766046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:19.768885 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1354/2695] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:19.780090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:19.781642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:19.838075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb31f7-e6d4-4b26-b349-6cd81a960033 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.839135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4ca7f-6068-493e-9826-735f9a5e6c84 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:19.843461 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1084f-3ee9-4a86-aa57-5f9f734dd2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.843684 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:19.844180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.844297 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1084f-3ee9-4a86-aa57-5f9f734dd2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.844455 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.844668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1084f-3ee9-4a86-aa57-5f9f734dd2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.844786 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] PATH_INFO: `/v3/users/5b3c1ca9c92b417e8baac958fe80faee` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.844977 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1084f-3ee9-4a86-aa57-5f9f734dd2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.845943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3c1ca9c92b417e8baac958fe80faee)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.847858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.854283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1084f-3ee9-4a86-aa57-5f9f734dd2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:19.855740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1084f-3ee9-4a86-aa57-5f9f734dd2c0 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:19.865165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1355/2696] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:19.900872 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3c1ca9c92b417e8baac958fe80faee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.913100 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3c1ca9c92b417e8baac958fe80faee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.921056 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3c1ca9c92b417e8baac958fe80faee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.921833 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3c1ca9c92b417e8baac958fe80faee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.922469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3c1ca9c92b417e8baac958fe80faee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:19.939133 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1342/2697] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:19 2022] DELETE /identity/v3/users/5b3c1ca9c92b417e8baac958fe80faee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:19.943936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:19.944321 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:19.944613 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:19.964011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:19.965233 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:20.001278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:20.043083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1356/2698] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:20.053752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:20.056608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:20.078808 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:20.133817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad5b4-604e-4018-a8f9-0fad74deeb48 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:20.145568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:20.146193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:20.146464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:20.146733 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:20.173560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:20.175109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:20.187363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1343/2699] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:20.498666 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:20.500576 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:20.514668 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052144e-a9d3-4379-9385-64478f2c7123 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:20.520982 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:20.521723 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:20.521978 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:20.522237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] PATH_INFO: `/v3/projects/05f4130019f041999944b17032d3d393` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:20.523404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f4130019f041999944b17032d3d393)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:20.525325 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:20.579950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f4130019f041999944b17032d3d393', 'request_id': 'req-cd31931e-0f9e-417b-8fe4-b9482702dd4a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.585783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f4130019f041999944b17032d3d393', 'request_id': 'req-cd31931e-0f9e-417b-8fe4-b9482702dd4a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.596364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f4130019f041999944b17032d3d393', 'request_id': 'req-cd31931e-0f9e-417b-8fe4-b9482702dd4a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.608858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] The token cache is being invalidate because project 05f4130019f041999944b17032d3d393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:20.609150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.609914 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.611947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1357/2700] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:20 2022] DELETE /identity/v3/projects/05f4130019f041999944b17032d3d393 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:20.617156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:20.627470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be53e5-652b-45c8-a2ac-fec410cc826a service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:20.700425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:20.701442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:20.702244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:20.702423 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] PATH_INFO: `/v3/users/c10fb15bb7f94037bad1d7f490ec68a0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:20.704020 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10fb15bb7f94037bad1d7f490ec68a0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:20.707498 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:20.772626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10fb15bb7f94037bad1d7f490ec68a0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.786019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10fb15bb7f94037bad1d7f490ec68a0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.795693 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10fb15bb7f94037bad1d7f490ec68a0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.796452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10fb15bb7f94037bad1d7f490ec68a0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.797120 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c09361a-d987-4a12-b819-aa1d7b85b6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10fb15bb7f94037bad1d7f490ec68a0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:20.813070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1344/2701] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:20 2022] DELETE /identity/v3/users/c10fb15bb7f94037bad1d7f490ec68a0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:21.110328 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:21.111897 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:21.128261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31931e-0f9e-417b-8fe4-b9482702dd4a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:21.189817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:21.190452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.190721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.190989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] PATH_INFO: `/v3/projects/8f6f23e4874349bcab8f294d6b76844d` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.192095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6f23e4874349bcab8f294d6b76844d)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:21.194019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:21.257490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6f23e4874349bcab8f294d6b76844d', 'request_id': 'req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:21.267282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6f23e4874349bcab8f294d6b76844d', 'request_id': 'req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:21.270047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:21.289158 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6f23e4874349bcab8f294d6b76844d', 'request_id': 'req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:21.294495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] The token cache is being invalidate because project 8f6f23e4874349bcab8f294d6b76844d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:21.294782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:21.296640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ef8e6cdf-3309-4bb4-8efe-db2ac0ba4c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:21.297929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1358/2702] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:21 2022] DELETE /identity/v3/projects/8f6f23e4874349bcab8f294d6b76844d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:21.305820 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305dc9-e525-45ca-8fa8-52c97e937866 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.306346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305dc9-e525-45ca-8fa8-52c97e937866 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.306807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52305dc9-e525-45ca-8fa8-52c97e937866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.348117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-52305dc9-e525-45ca-8fa8-52c97e937866 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:21.349863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-52305dc9-e525-45ca-8fa8-52c97e937866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:21.415901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:21.477718 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1345/2703] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:21.489501 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2d25-a595-4cd2-831f-af2cd1100afb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.489787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2d25-a595-4cd2-831f-af2cd1100afb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.490065 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2d25-a595-4cd2-831f-af2cd1100afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.511724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a28e2d25-a595-4cd2-831f-af2cd1100afb None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:21.513094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a28e2d25-a595-4cd2-831f-af2cd1100afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:21.529036 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1359/2704] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:21.534826 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305dc9-e525-45ca-8fa8-52c97e937866 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:21.548561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52305dc9-e525-45ca-8fa8-52c97e937866 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:21.558695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:21.559489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.559863 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.560226 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.561071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:21.561626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:21.563530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:21.579592 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1346/2705] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:21.583954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e2d25-a595-4cd2-831f-af2cd1100afb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:21.594100 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e2d25-a595-4cd2-831f-af2cd1100afb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:21.601323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:21.601938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.602212 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.602476 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.603103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:21.605007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:21.639063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1360/2706] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:21 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:21.643092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:21.654687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6ea5-1f6b-47f1-a317-3c382e49d67d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:21.731359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:21.732091 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.733185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.733669 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.734540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:21.736597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:21.768841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1347/2707] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:21 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:21.771831 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:21.788651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43eb47-dcb1-483a-a0a8-189a213fdd70 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:21.794437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:21.795694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.795694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.795966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.796544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:21.798536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:21.815357 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1361/2708] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:21.816038 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:21.830244 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e1282-16d3-4786-9221-507094dedf7a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:21.844630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15968bc0-ba1b-4b29-9c04-12188335d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:21.845516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15968bc0-ba1b-4b29-9c04-12188335d78a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.845871 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15968bc0-ba1b-4b29-9c04-12188335d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.846233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15968bc0-ba1b-4b29-9c04-12188335d78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.848848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15968bc0-ba1b-4b29-9c04-12188335d78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:21.853005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15968bc0-ba1b-4b29-9c04-12188335d78a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:21.875659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1348/2709] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:12:21.880002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:21.895557 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3cc5-e0db-4fc2-8e6f-fb0df4abd419 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:21.900819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:21.901619 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.901965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.902265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] PATH_INFO: `/v3/projects/a7a020f57034446eb54814b16d71c5e8/users/b1f3fb88fe13493da9ec6c9a309b5aad/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.926365 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a020f57034446eb54814b16d71c5e8, user_id=b1f3fb88fe13493da9ec6c9a309b5aad, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:21.929346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:21.957957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1362/2710] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:21 2022] PUT /identity/v3/projects/a7a020f57034446eb54814b16d71c5e8/users/b1f3fb88fe13493da9ec6c9a309b5aad/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:21.960072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d6860-080d-459d-babb-421cac146778 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:21.960072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d6860-080d-459d-babb-421cac146778 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:21.960364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d6860-080d-459d-babb-421cac146778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:21.997668 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2f8d6860-080d-459d-babb-421cac146778 None None] MFA Rules not processed for user `b1f3fb88fe13493da9ec6c9a309b5aad`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:21.999523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f8d6860-080d-459d-babb-421cac146778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:22.096269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1349/2711] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:22.101179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.198790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89124523-d622-47d9-994a-6a204ed4cd98 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.204731 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.205380 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.205942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.205942 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.206555 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.208446 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.239522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1363/2712] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:22 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:22.243658 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d6860-080d-459d-babb-421cac146778 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.255080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d6860-080d-459d-babb-421cac146778 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.288428 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:22.323505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.324253 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.324558 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.324876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.325556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.327799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.355873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1350/2713] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:22 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:12:22.360038 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.373202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bf29d-44b2-42a8-b5a8-b1075e72fb2d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.379827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.384843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.384843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.384843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.384843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.384843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.404274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1364/2714] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:22.409917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.420850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929e468-f738-4c81-ac71-97408bf29bae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.426034 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.426803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.427277 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.427611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] PATH_INFO: `/v3/projects/84b1c7b622b047c4b881d4f058f65e87/users/5960c8a4424c458eb08ea26993ae640d/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.452017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b1c7b622b047c4b881d4f058f65e87, user_id=5960c8a4424c458eb08ea26993ae640d, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.453459 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.470665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1351/2715] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:22 2022] PUT /identity/v3/projects/84b1c7b622b047c4b881d4f058f65e87/users/5960c8a4424c458eb08ea26993ae640d/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:22.474968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.492929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87e3b-6997-46e5-8949-a231a4e53bca admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.563975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58ab8b-225d-412c-ab23-22a578360118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.564714 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58ab8b-225d-412c-ab23-22a578360118 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.564863 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58ab8b-225d-412c-ab23-22a578360118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.565136 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58ab8b-225d-412c-ab23-22a578360118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.565921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58ab8b-225d-412c-ab23-22a578360118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.567507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58ab8b-225d-412c-ab23-22a578360118 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.569033 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:22.585436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.592143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1365/2716] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:22.598060 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd0a52-8c57-45b1-a599-b246ac1c1827 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.605500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.606179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.606454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.606729 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] PATH_INFO: `/v3/projects/84b1c7b622b047c4b881d4f058f65e87/users/5960c8a4424c458eb08ea26993ae640d/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.609918 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b1c7b622b047c4b881d4f058f65e87, user_id=5960c8a4424c458eb08ea26993ae640d, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.613388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.626153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1352/2717] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:22 2022] PUT /identity/v3/projects/84b1c7b622b047c4b881d4f058f65e87/users/5960c8a4424c458eb08ea26993ae640d/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:22.636733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c6db-4eb0-48d4-873b-488dd1471e92 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.637274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c6db-4eb0-48d4-873b-488dd1471e92 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.637548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c6db-4eb0-48d4-873b-488dd1471e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.669518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7244c6db-4eb0-48d4-873b-488dd1471e92 None None] MFA Rules not processed for user `5960c8a4424c458eb08ea26993ae640d`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:22.671074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7244c6db-4eb0-48d4-873b-488dd1471e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:22.763512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1366/2718] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:22.785393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.785905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:22.858316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962febb1-a1fe-4816-a02e-c1d4447e81b3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.862842 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.863473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.863748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.864017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.875749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.877287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.888492 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1353/2719] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:23.006251 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244c6db-4eb0-48d4-873b-488dd1471e92 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:23.018170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244c6db-4eb0-48d4-873b-488dd1471e92 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:23.022424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4317c-a6a3-4542-a210-a1b7084136d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:23.023053 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4317c-a6a3-4542-a210-a1b7084136d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:23.023311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4317c-a6a3-4542-a210-a1b7084136d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:23.023679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4317c-a6a3-4542-a210-a1b7084136d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:23.102506 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4317c-a6a3-4542-a210-a1b7084136d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:23.104270 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4317c-a6a3-4542-a210-a1b7084136d6 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:23.120936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1367/2720] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:23.227122 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:23.228607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:23.309067 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda7bcb-28b0-4b3a-8f82-369f36021766 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:23.314069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:23.314880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:23.315308 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:23.315616 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] PATH_INFO: `/v3/users/20280490bbc34c059ae271ae5ac0f570` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:23.316912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20280490bbc34c059ae271ae5ac0f570)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:23.318979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:23.360963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:23.378167 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20280490bbc34c059ae271ae5ac0f570'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:23.395799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20280490bbc34c059ae271ae5ac0f570'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:23.405610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20280490bbc34c059ae271ae5ac0f570'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:23.406745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20280490bbc34c059ae271ae5ac0f570'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:23.407520 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20280490bbc34c059ae271ae5ac0f570'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:23.427242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1354/2721] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:23 2022] DELETE /identity/v3/users/20280490bbc34c059ae271ae5ac0f570 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:23.431838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:23.432016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:23.432292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:23.461392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:23.470947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:23.542693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1368/2722] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:23.552647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:23.554561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:23.617705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aeb59-44c8-4803-863e-cc12cfce793e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:23.621784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c8cd-c7e6-4d05-8843-e40b702fa0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:23.622391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c8cd-c7e6-4d05-8843-e40b702fa0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:23.622665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c8cd-c7e6-4d05-8843-e40b702fa0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:23.622934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c8cd-c7e6-4d05-8843-e40b702fa0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:23.632723 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c8cd-c7e6-4d05-8843-e40b702fa0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:23.635033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c8cd-c7e6-4d05-8843-e40b702fa0a3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:23.645234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1355/2723] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:12:23.935468 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:23.937094 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:23.950509 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912335-4c26-42f3-a07c-01ebd4d5df1f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:23.955957 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:23.956580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:23.956905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:23.957170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] PATH_INFO: `/v3/projects/b981ed958724481281f6f649a8ccc601` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:23.958464 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b981ed958724481281f6f649a8ccc601)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:23.960693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:23.980016 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:24.015286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b981ed958724481281f6f649a8ccc601', 'request_id': 'req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:24.021541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b981ed958724481281f6f649a8ccc601', 'request_id': 'req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:24.031157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b981ed958724481281f6f649a8ccc601', 'request_id': 'req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:24.043344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] The token cache is being invalidate because project b981ed958724481281f6f649a8ccc601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:24.043637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:24.044418 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9c6e6212-73cc-4533-b3e6-ac1fad7fed25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:24.046149 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1369/2724] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:23 2022] DELETE /identity/v3/projects/b981ed958724481281f6f649a8ccc601 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:24.051896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806d99-989d-4e3b-8e9b-7e2c69fa1248 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.052377 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806d99-989d-4e3b-8e9b-7e2c69fa1248 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.052470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806d99-989d-4e3b-8e9b-7e2c69fa1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.081543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a0806d99-989d-4e3b-8e9b-7e2c69fa1248 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:24.082764 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a0806d99-989d-4e3b-8e9b-7e2c69fa1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:24.160266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1356/2725] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:24.168401 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f081d4-ef15-486d-abdf-495feb30f19e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.168687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f081d4-ef15-486d-abdf-495feb30f19e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.168994 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f081d4-ef15-486d-abdf-495feb30f19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.189637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-79f081d4-ef15-486d-abdf-495feb30f19e None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:24.190783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-79f081d4-ef15-486d-abdf-495feb30f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:24.200134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1370/2726] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:24.205497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806d99-989d-4e3b-8e9b-7e2c69fa1248 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.220051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806d99-989d-4e3b-8e9b-7e2c69fa1248 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.225677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.226285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.226563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.226836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.227510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:24.227813 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.229463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.241716 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1357/2727] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:24.246217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f081d4-ef15-486d-abdf-495feb30f19e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.256278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f081d4-ef15-486d-abdf-495feb30f19e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.261734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.262340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.262621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.262889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.263515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.265608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.302469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1371/2728] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:12:24.309071 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.320281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821c784-c069-4909-9740-2bad8b16f0a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.359602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:24.391882 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.392571 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.392891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.393164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.393801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.395752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.420865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1358/2729] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:24.425404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.436135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c735ab3-85bc-43fa-820c-a4fa13af3917 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.442112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.442647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.442931 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.443208 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.443821 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.445460 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.456361 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1372/2730] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:24.460596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.474431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fa695-c588-4181-b4d8-849f6ab5d15c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.480187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f9cde-bc11-4a8a-9481-6c72b04edfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.480791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f9cde-bc11-4a8a-9481-6c72b04edfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.481103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f9cde-bc11-4a8a-9481-6c72b04edfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.481354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f9cde-bc11-4a8a-9481-6c72b04edfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.481997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f9cde-bc11-4a8a-9481-6c72b04edfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.483746 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f9cde-bc11-4a8a-9481-6c72b04edfd9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.495960 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1359/2731] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:12:24.500678 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.511302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1963-5b11-4ed2-9c30-c22ae1af9da2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.517178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.517826 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.518103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.518399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] PATH_INFO: `/v3/projects/fc4b9ff10ed24692af082364b691bf0d/users/1487961d11f54130aae55ea5db103490/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.536980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4b9ff10ed24692af082364b691bf0d, user_id=1487961d11f54130aae55ea5db103490, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.539607 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.563344 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1373/2732] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:24 2022] PUT /identity/v3/projects/fc4b9ff10ed24692af082364b691bf0d/users/1487961d11f54130aae55ea5db103490/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:24.565909 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c072-8e73-465b-8ba5-981d0782eee9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.566188 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c072-8e73-465b-8ba5-981d0782eee9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.566454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c072-8e73-465b-8ba5-981d0782eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.598986 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5736c072-8e73-465b-8ba5-981d0782eee9 None None] MFA Rules not processed for user `1487961d11f54130aae55ea5db103490`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:24.600454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5736c072-8e73-465b-8ba5-981d0782eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:24.694261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1360/2733] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:24.696734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.772050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cef48a-e45f-41f8-bfb8-2c244eccc6df admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.777830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.778484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.778735 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.779028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.779844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.784901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.813794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1374/2734] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:24.818107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736c072-8e73-465b-8ba5-981d0782eee9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.829994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736c072-8e73-465b-8ba5-981d0782eee9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.901841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.902460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.902735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.903005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.903649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.906202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.931537 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1361/2735] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:24.935614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.946566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a056f7b-4bc7-4515-b279-b400a7d35873 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.951337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.951962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.952228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.952493 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.953204 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.954884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:24.966473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1375/2736] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:24.970671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:24.981384 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf9b48-d9d6-4c01-9eed-9978b5c95966 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:24.987289 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0bd73-2270-4841-b938-43c452f7dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:24.987907 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0bd73-2270-4841-b938-43c452f7dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.988187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0bd73-2270-4841-b938-43c452f7dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.988521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0bd73-2270-4841-b938-43c452f7dc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.989164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0bd73-2270-4841-b938-43c452f7dc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:24.990778 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0bd73-2270-4841-b938-43c452f7dc32 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.002041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1362/2737] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:25.006334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.016926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c22b8a-e903-4266-83c9-c2da23db2fa8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.022872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.023511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.023787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.024054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] PATH_INFO: `/v3/projects/6c4d80246e874159a4bdcd4a26d76cbf/users/140462e35e0e4ba4a1d964cb23d0e874/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.036553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:25.041259 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d80246e874159a4bdcd4a26d76cbf, user_id=140462e35e0e4ba4a1d964cb23d0e874, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.044447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.059515 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1376/2738] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:25 2022] PUT /identity/v3/projects/6c4d80246e874159a4bdcd4a26d76cbf/users/140462e35e0e4ba4a1d964cb23d0e874/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:25.071534 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cda96-1544-45a1-b757-6af0b1f3b591 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.072068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cda96-1544-45a1-b757-6af0b1f3b591 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.072068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cda96-1544-45a1-b757-6af0b1f3b591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.102763 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-050cda96-1544-45a1-b757-6af0b1f3b591 None None] MFA Rules not processed for user `140462e35e0e4ba4a1d964cb23d0e874`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:25.103982 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-050cda96-1544-45a1-b757-6af0b1f3b591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:25.116379 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:25.181018 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1363/2739] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:25.186684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.253808 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeb10d-d3d1-489f-bac3-9922d15ebe70 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.259717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.260346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.260623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.260950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.261561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.263449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.291775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1377/2740] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:25 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:25.298323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cda96-1544-45a1-b757-6af0b1f3b591 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.314511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cda96-1544-45a1-b757-6af0b1f3b591 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.375350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.375966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.376241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.376505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.377174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.379150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.402742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1364/2741] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:25 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:25.407040 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.417170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640d8b-4f6b-4b28-8284-375d1fc6efdf admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.422002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.422605 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.422888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.423156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.423847 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.425447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.450820 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1378/2742] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:25.457420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.470483 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4691d05-1475-4060-bfd6-aa63b5b1c47d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.476338 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.477045 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.477316 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.477590 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] PATH_INFO: `/v3/projects/b61590e4e3ca492cbc487cdf1edf15b9/users/be815d5055d9427f90cc423d038e7db6/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.494583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61590e4e3ca492cbc487cdf1edf15b9, user_id=be815d5055d9427f90cc423d038e7db6, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.497309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.511767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1365/2743] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:25 2022] PUT /identity/v3/projects/b61590e4e3ca492cbc487cdf1edf15b9/users/be815d5055d9427f90cc423d038e7db6/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:25.516147 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.526289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c66bd-d006-465a-9298-5ab0ed04df03 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.599806 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226241d-9b59-482f-bfcb-1e70131d7390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.601890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226241d-9b59-482f-bfcb-1e70131d7390 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.602095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226241d-9b59-482f-bfcb-1e70131d7390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.602819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226241d-9b59-482f-bfcb-1e70131d7390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.603165 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226241d-9b59-482f-bfcb-1e70131d7390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.606089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226241d-9b59-482f-bfcb-1e70131d7390 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.621720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1379/2744] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:25.626273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.637481 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b173-e110-4de8-af69-6f7ed10bc6d2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.643640 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.644424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.644705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.645006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] PATH_INFO: `/v3/projects/b61590e4e3ca492cbc487cdf1edf15b9/users/be815d5055d9427f90cc423d038e7db6/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.647089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61590e4e3ca492cbc487cdf1edf15b9, user_id=be815d5055d9427f90cc423d038e7db6, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.649790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.662109 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1366/2745] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:25 2022] PUT /identity/v3/projects/b61590e4e3ca492cbc487cdf1edf15b9/users/be815d5055d9427f90cc423d038e7db6/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:25.673617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.673943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.674223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.707709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] MFA Rules not processed for user `be815d5055d9427f90cc423d038e7db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:25.709052 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:25.771934 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:25.782083 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.783942 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:25.803594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1380/2746] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:25.816639 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.818294 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:25.851913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4516bb-71ce-4602-8aab-d9e04bebdbdb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.857887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.858612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.858900 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.859168 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] PATH_INFO: `/v3/users/b1f3fb88fe13493da9ec6c9a309b5aad` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.860370 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f3fb88fe13493da9ec6c9a309b5aad)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.862341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.867853 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:25.879277 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a512e74-f67d-4b0c-b2b2-117506d842b4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.883025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53133d-9a18-4a11-845e-0ec7030cd35b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.883643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53133d-9a18-4a11-845e-0ec7030cd35b service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.883941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53133d-9a18-4a11-845e-0ec7030cd35b service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.884211 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53133d-9a18-4a11-845e-0ec7030cd35b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.924225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f3fb88fe13493da9ec6c9a309b5aad'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:25.942229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f3fb88fe13493da9ec6c9a309b5aad'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:25.948059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53133d-9a18-4a11-845e-0ec7030cd35b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.949477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53133d-9a18-4a11-845e-0ec7030cd35b service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.951028 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f3fb88fe13493da9ec6c9a309b5aad'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:25.951887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f3fb88fe13493da9ec6c9a309b5aad'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:25.952617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f3fb88fe13493da9ec6c9a309b5aad'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:25.959621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1381/2747] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:25.983061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1367/2748] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:25 2022] DELETE /identity/v3/users/b1f3fb88fe13493da9ec6c9a309b5aad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:25.987429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4d82-fd0c-4c58-a096-087d02dba52c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.987702 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4d82-fd0c-4c58-a096-087d02dba52c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.987970 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4d82-fd0c-4c58-a096-087d02dba52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:26.012437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-23fe4d82-fd0c-4c58-a096-087d02dba52c None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:26.012437 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-23fe4d82-fd0c-4c58-a096-087d02dba52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:26.019066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:26.020665 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:26.081963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1382/2749] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:26.085755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3bc8-b2bd-4a69-9f22-38a49eb2850f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:26.089749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:26.090436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:26.090721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:26.091300 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:26.093900 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe4d82-fd0c-4c58-a096-087d02dba52c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:26.094068 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:26.104936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe4d82-fd0c-4c58-a096-087d02dba52c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:26.108884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:26.109716 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:26.110007 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:26.110274 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:26.113824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:26.115388 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:26.120105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:26.121546 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:26.128597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1368/2750] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:12:26.135235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1383/2751] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:26.635141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:26.636614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:26.650601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c499dbc-8860-463c-9c0c-3f71d1fbac15 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:26.656245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:26.656884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:26.657228 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:26.657566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] PATH_INFO: `/v3/projects/a7a020f57034446eb54814b16d71c5e8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:26.658803 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a020f57034446eb54814b16d71c5e8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:26.660969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:26.714938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a020f57034446eb54814b16d71c5e8', 'request_id': 'req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.722378 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a020f57034446eb54814b16d71c5e8', 'request_id': 'req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.730131 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a020f57034446eb54814b16d71c5e8', 'request_id': 'req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.753514 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] The token cache is being invalidate because project a7a020f57034446eb54814b16d71c5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:26.754970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.754970 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.757011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1369/2752] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:26 2022] DELETE /identity/v3/projects/a7a020f57034446eb54814b16d71c5e8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:26.762080 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:26.773134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de764f35-d536-42bd-aae1-9a018c6c49a7 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:26.799356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:26.837938 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:26.838579 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:26.838853 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:26.839123 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] PATH_INFO: `/v3/users/5960c8a4424c458eb08ea26993ae640d` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:26.840263 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5960c8a4424c458eb08ea26993ae640d)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:26.842840 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:26.894156 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5960c8a4424c458eb08ea26993ae640d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.902028 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5960c8a4424c458eb08ea26993ae640d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.911157 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5960c8a4424c458eb08ea26993ae640d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.911893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5960c8a4424c458eb08ea26993ae640d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.924788 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5960c8a4424c458eb08ea26993ae640d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:26.930787 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1384/2753] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:26 2022] DELETE /identity/v3/users/5960c8a4424c458eb08ea26993ae640d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:27.368301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:27.372019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:27.391233 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc8fd-d30e-418a-b949-b5aed98b77f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:27.402761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:27.538760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:27.539411 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:27.539860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:27.540331 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] PATH_INFO: `/v3/projects/84b1c7b622b047c4b881d4f058f65e87` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:27.541750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b1c7b622b047c4b881d4f058f65e87)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:27.543839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:27.599072 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b1c7b622b047c4b881d4f058f65e87', 'request_id': 'req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:27.606529 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b1c7b622b047c4b881d4f058f65e87', 'request_id': 'req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:27.614988 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b1c7b622b047c4b881d4f058f65e87', 'request_id': 'req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:27.617936 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:27.619368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:27.629835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] The token cache is being invalidate because project 84b1c7b622b047c4b881d4f058f65e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:27.630138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:27.631030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8217ff2f-5872-4f9f-9585-7368fb2ee5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:27.633006 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1370/2754] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:27 2022] DELETE /identity/v3/projects/84b1c7b622b047c4b881d4f058f65e87 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:27.638297 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1251f-6848-4ea5-869a-fbcda80818af None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:27.638717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1251f-6848-4ea5-869a-fbcda80818af None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:27.639281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1251f-6848-4ea5-869a-fbcda80818af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:27.664263 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-42e1251f-6848-4ea5-869a-fbcda80818af None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:27.665836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-42e1251f-6848-4ea5-869a-fbcda80818af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:27.686114 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc9d22-bd4f-4aa3-80fa-1883e53f1ff6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:27.739118 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1371/2755] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:27.743417 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:27.744738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:27.745371 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:27.745844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:27.759241 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:27.784538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:27.810686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1572271-c381-400b-8e18-e81e502ec4bc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:27.810686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1572271-c381-400b-8e18-e81e502ec4bc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:27.810686 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1572271-c381-400b-8e18-e81e502ec4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:27.834412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f1572271-c381-400b-8e18-e81e502ec4bc None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:27.835711 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f1572271-c381-400b-8e18-e81e502ec4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:27.839699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:27.843095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:27.853249 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1372/2756] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:27.857510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1385/2757] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:27.869919 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1572271-c381-400b-8e18-e81e502ec4bc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:27.884572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1572271-c381-400b-8e18-e81e502ec4bc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:27.890026 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:27.890631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:27.890980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:27.891368 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:27.892092 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:27.892457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:27.894179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:27.908850 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1373/2758] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:27.914278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:27.929624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb4f6d-23eb-4504-951f-68440b92c232 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:27.939141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:27.940064 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:27.940673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:27.941935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:27.942990 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:27.945984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:28.017169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1386/2759] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:27 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:28.022032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:28.034130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338efd55-f65a-49fe-afdd-f7e4a49a3e54 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:28.066572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:28.142218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:28.143234 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:28.143789 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:28.144599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:28.145156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:28.147839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:28.177193 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1374/2760] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:28 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:28.181329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:28.195032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e4644-6972-478b-94cd-461a5233bf16 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:28.203286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:28.203916 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:28.204320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:28.204766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:28.205830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:28.207880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:28.222072 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1387/2761] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:28.225119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:28.236675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a2b0-d6cf-4050-9bf0-941477b2b807 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:28.241832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aae3f2-7b6f-46f5-b257-93b8d8b85973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:28.242491 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae3f2-7b6f-46f5-b257-93b8d8b85973 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:28.242989 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae3f2-7b6f-46f5-b257-93b8d8b85973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:28.243245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae3f2-7b6f-46f5-b257-93b8d8b85973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:28.244090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aae3f2-7b6f-46f5-b257-93b8d8b85973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:28.245753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aae3f2-7b6f-46f5-b257-93b8d8b85973 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:28.268005 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1375/2762] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:28.272999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:28.287059 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6408e-e69a-4af7-b87e-aba1620a7213 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:28.297164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:28.298029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:28.302249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:28.302249 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] PATH_INFO: `/v3/projects/7897e249691b4112b157e838978cbffb/users/44903f9c97314026943154d3561bcc7f/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:28.331966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7897e249691b4112b157e838978cbffb, user_id=44903f9c97314026943154d3561bcc7f, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:28.336573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:28.360356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1388/2763] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:28 2022] PUT /identity/v3/projects/7897e249691b4112b157e838978cbffb/users/44903f9c97314026943154d3561bcc7f/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:28.371629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:28.372421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:28.372421 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:28.411206 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] MFA Rules not processed for user `44903f9c97314026943154d3561bcc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:28.414359 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:28.569255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1376/2764] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:28.570292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:28.572082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:28.642896 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:28.644732 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:28.660915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30153210-9703-4b43-a6df-30a16fe9092b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:28.665285 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:28.665900 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:28.666174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:28.666441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:28.677280 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:28.679320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:28.694083 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1389/2765] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:28.730824 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee09e94-ff55-4c26-9b35-100c33d84ec1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:28.735652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:28.736630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:28.736931 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:28.737199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:28.739007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:28.792647 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:28.815224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:28.816846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:28.828039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1377/2766] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:12:29.766695 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:29.769532 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:29.831489 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:29.845625 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104de929-a452-46f9-9bc0-6f3024e2e8f3 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:29.850435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:29.851108 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:29.851423 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:29.851960 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] PATH_INFO: `/v3/users/e2b354bfe62742e3bce1b8ec7eb85e50` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:29.866271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b354bfe62742e3bce1b8ec7eb85e50)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:29.868168 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:29.926221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b354bfe62742e3bce1b8ec7eb85e50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:29.933282 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b354bfe62742e3bce1b8ec7eb85e50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:29.943336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b354bfe62742e3bce1b8ec7eb85e50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:29.943925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b354bfe62742e3bce1b8ec7eb85e50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:29.957284 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-debcaac5-acd9-4b01-b3c2-c56b790ea359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b354bfe62742e3bce1b8ec7eb85e50'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:29.963985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1390/2767] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:29 2022] DELETE /identity/v3/users/e2b354bfe62742e3bce1b8ec7eb85e50 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:30.157281 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.175074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012dbf-d5e2-4d15-bca9-fa41cbee0bd0 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:30.254614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:30.255391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.255857 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.256306 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] PATH_INFO: `/v3/projects/98a86c7c9ea1414abfa71ac7e3f03ed4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.268876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a86c7c9ea1414abfa71ac7e3f03ed4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:30.271069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:30.344227 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a86c7c9ea1414abfa71ac7e3f03ed4', 'request_id': 'req-6c03fdee-46c9-4eb9-b4bb-32148daf243b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:30.351615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a86c7c9ea1414abfa71ac7e3f03ed4', 'request_id': 'req-6c03fdee-46c9-4eb9-b4bb-32148daf243b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:30.361814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a86c7c9ea1414abfa71ac7e3f03ed4', 'request_id': 'req-6c03fdee-46c9-4eb9-b4bb-32148daf243b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:30.380496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] The token cache is being invalidate because project 98a86c7c9ea1414abfa71ac7e3f03ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:30.380782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:30.381475 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6c03fdee-46c9-4eb9-b4bb-32148daf243b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:30.383066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1378/2768] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:30 2022] DELETE /identity/v3/projects/98a86c7c9ea1414abfa71ac7e3f03ed4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:30.389524 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a941-79c2-4d5a-8cb4-53445a22e186 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.390070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a941-79c2-4d5a-8cb4-53445a22e186 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.390462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a941-79c2-4d5a-8cb4-53445a22e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.412584 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0168a941-79c2-4d5a-8cb4-53445a22e186 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:30.413905 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0168a941-79c2-4d5a-8cb4-53445a22e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:30.476890 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1391/2769] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:30.485156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fe8fe-1221-420f-ad3d-cc1cacf5d1a4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.485436 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fe8fe-1221-420f-ad3d-cc1cacf5d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.485702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fe8fe-1221-420f-ad3d-cc1cacf5d1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.507774 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d52fe8fe-1221-420f-ad3d-cc1cacf5d1a4 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:30.509057 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d52fe8fe-1221-420f-ad3d-cc1cacf5d1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:30.522013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1379/2770] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:30.526650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168a941-79c2-4d5a-8cb4-53445a22e186 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.537042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168a941-79c2-4d5a-8cb4-53445a22e186 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:30.542739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:30.543355 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.543637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.543903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.544589 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:30.544986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:30.547162 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:30.560109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1392/2771] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:12:30.565360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fe8fe-1221-420f-ad3d-cc1cacf5d1a4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.575389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fe8fe-1221-420f-ad3d-cc1cacf5d1a4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:30.581080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:30.581682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.581956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.582222 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.582876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:30.584840 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:30.615876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1380/2772] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:30 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:30.620454 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.632565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369529c0-8cbd-41c7-9648-5d18f59d8939 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:30.684749 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:30.703140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:30.703752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.704025 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.704320 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.705075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:30.707305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:30.731577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1393/2773] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:30 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:30.735873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.747284 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadd938-6285-41b0-b3c9-9c29f960f14e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:30.753035 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:30.753619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.753890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.754152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.754793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:30.756392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:30.767393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1381/2774] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:30.771665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.782384 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03527f6-fc01-4363-a249-88a81e61febd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:30.788699 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae38b3-97d4-4790-a9aa-95f33ef7ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:30.789356 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae38b3-97d4-4790-a9aa-95f33ef7ce28 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.789632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae38b3-97d4-4790-a9aa-95f33ef7ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.789907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae38b3-97d4-4790-a9aa-95f33ef7ce28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.790577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae38b3-97d4-4790-a9aa-95f33ef7ce28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:30.792178 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae38b3-97d4-4790-a9aa-95f33ef7ce28 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:30.804163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1394/2775] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:30.809649 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.820526 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612b1d-3d4e-41d3-9f89-260f51e0ad43 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:30.827214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:30.828181 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.828525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.829048 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] PATH_INFO: `/v3/projects/7e633c1dc48c40e3b34c4eacf76ca2f7/users/aa2bd36c0ca74981842828bdb55ad1ef/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.849932 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e633c1dc48c40e3b34c4eacf76ca2f7, user_id=aa2bd36c0ca74981842828bdb55ad1ef, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:30.853081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:30.864229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:30.871237 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1382/2776] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:30 2022] PUT /identity/v3/projects/7e633c1dc48c40e3b34c4eacf76ca2f7/users/aa2bd36c0ca74981842828bdb55ad1ef/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:30.883698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:30.883980 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:30.884256 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:30.913849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] MFA Rules not processed for user `aa2bd36c0ca74981842828bdb55ad1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:30.915074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:30.984387 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1395/2777] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:30.997080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:30.999983 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:31.082241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe1e26-d553-4b4d-aaf3-3d501d14be05 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:31.089877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593b6bc-41fb-4d7c-864d-dbb7c39efe56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:31.090734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b6bc-41fb-4d7c-864d-dbb7c39efe56 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:31.091352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b6bc-41fb-4d7c-864d-dbb7c39efe56 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:31.091832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b6bc-41fb-4d7c-864d-dbb7c39efe56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:31.101150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593b6bc-41fb-4d7c-864d-dbb7c39efe56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:31.102742 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593b6bc-41fb-4d7c-864d-dbb7c39efe56 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:31.112199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1383/2778] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:32.901755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:32.903614 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:32.997624 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a123314-103b-49f0-9578-a443ffcc48b1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:33.002752 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:33.003392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:33.003671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:33.003944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] PATH_INFO: `/v3/users/1487961d11f54130aae55ea5db103490` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:33.005194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1487961d11f54130aae55ea5db103490)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:33.007119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:33.067943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1487961d11f54130aae55ea5db103490'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.076595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1487961d11f54130aae55ea5db103490'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.079385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:33.088986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1487961d11f54130aae55ea5db103490'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.089984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1487961d11f54130aae55ea5db103490'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.109453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1487961d11f54130aae55ea5db103490'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.115765 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1396/2779] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:32 2022] DELETE /identity/v3/users/1487961d11f54130aae55ea5db103490 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:33.122225 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:33.122766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:33.122766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:33.143667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:33.144912 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:33.209013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1384/2780] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:33.220694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:33.222250 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:33.288323 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70088783-4e5a-48dc-8811-fdb81e364527 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:33.294804 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:33.295596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:33.296081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:33.296539 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:33.309031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:33.310567 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:33.320846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1397/2781] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:33.621875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:33.623382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:33.637546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55274-890e-4976-867e-c424a4e9523a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:33.642552 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:33.643214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:33.643489 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:33.643758 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] PATH_INFO: `/v3/projects/fc4b9ff10ed24692af082364b691bf0d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:33.645479 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4b9ff10ed24692af082364b691bf0d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:33.647701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:33.702346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4b9ff10ed24692af082364b691bf0d', 'request_id': 'req-77846a5a-9a81-40b9-929f-f8769541356a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.708911 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4b9ff10ed24692af082364b691bf0d', 'request_id': 'req-77846a5a-9a81-40b9-929f-f8769541356a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.715094 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4b9ff10ed24692af082364b691bf0d', 'request_id': 'req-77846a5a-9a81-40b9-929f-f8769541356a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.730221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] The token cache is being invalidate because project fc4b9ff10ed24692af082364b691bf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:33.730500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.731128 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.732748 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1385/2782] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:33 2022] DELETE /identity/v3/projects/fc4b9ff10ed24692af082364b691bf0d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:33.737683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:33.751119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa78686-2fb4-4ab7-862c-c31f301a2479 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:33.814243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:33.814872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:33.815146 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:33.815414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] PATH_INFO: `/v3/users/140462e35e0e4ba4a1d964cb23d0e874` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:33.816535 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140462e35e0e4ba4a1d964cb23d0e874)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:33.818469 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:33.866193 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140462e35e0e4ba4a1d964cb23d0e874'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.881520 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140462e35e0e4ba4a1d964cb23d0e874'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.882810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140462e35e0e4ba4a1d964cb23d0e874'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.883538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140462e35e0e4ba4a1d964cb23d0e874'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.896132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140462e35e0e4ba4a1d964cb23d0e874'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:33.897818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:33.904832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1398/2783] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:33 2022] DELETE /identity/v3/users/140462e35e0e4ba4a1d964cb23d0e874 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:34.276883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:34.279098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:34.304015 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77846a5a-9a81-40b9-929f-f8769541356a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:34.309369 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:34.376163 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:34.376830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:34.377117 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:34.377382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] PATH_INFO: `/v3/projects/6c4d80246e874159a4bdcd4a26d76cbf` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:34.378500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4d80246e874159a4bdcd4a26d76cbf)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:34.381123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:34.437981 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4d80246e874159a4bdcd4a26d76cbf', 'request_id': 'req-e7d50f65-b89f-4c64-aace-a3038459c901'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.445606 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4d80246e874159a4bdcd4a26d76cbf', 'request_id': 'req-e7d50f65-b89f-4c64-aace-a3038459c901'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.452180 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4d80246e874159a4bdcd4a26d76cbf', 'request_id': 'req-e7d50f65-b89f-4c64-aace-a3038459c901'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.468835 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] The token cache is being invalidate because project 6c4d80246e874159a4bdcd4a26d76cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:34.469170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.469880 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.471625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1386/2784] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:34 2022] DELETE /identity/v3/projects/6c4d80246e874159a4bdcd4a26d76cbf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:34.475596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:34.477671 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:34.493143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846da47-84a4-49ab-ad4e-704860c6e3a3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:34.578473 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:34.579534 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:34.579907 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:34.580725 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] PATH_INFO: `/v3/users/be815d5055d9427f90cc423d038e7db6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:34.582426 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be815d5055d9427f90cc423d038e7db6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:34.584588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:34.655696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be815d5055d9427f90cc423d038e7db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.663923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be815d5055d9427f90cc423d038e7db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.681109 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be815d5055d9427f90cc423d038e7db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.681734 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be815d5055d9427f90cc423d038e7db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.703884 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e594e4a6-e878-4784-87dc-204454b76875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be815d5055d9427f90cc423d038e7db6'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:34.711541 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1399/2785] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:34 2022] DELETE /identity/v3/users/be815d5055d9427f90cc423d038e7db6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:35.028043 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.030348 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:35.044110 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d50f65-b89f-4c64-aace-a3038459c901 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.106309 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.106938 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.107214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.107497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] PATH_INFO: `/v3/projects/b61590e4e3ca492cbc487cdf1edf15b9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.109250 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61590e4e3ca492cbc487cdf1edf15b9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.111205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.161994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:35.171387 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61590e4e3ca492cbc487cdf1edf15b9', 'request_id': 'req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:35.179373 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61590e4e3ca492cbc487cdf1edf15b9', 'request_id': 'req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:35.187066 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61590e4e3ca492cbc487cdf1edf15b9', 'request_id': 'req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:35.204229 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] The token cache is being invalidate because project b61590e4e3ca492cbc487cdf1edf15b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:35.204540 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:35.205242 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-755de1a9-8eb6-4bf8-b99f-ab5a3e95b72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:35.206800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1387/2786] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:35 2022] DELETE /identity/v3/projects/b61590e4e3ca492cbc487cdf1edf15b9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:35.213189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1c53-42d9-45a6-b6dc-660d64214a8a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.213782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1c53-42d9-45a6-b6dc-660d64214a8a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.213782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a1c53-42d9-45a6-b6dc-660d64214a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.239935 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-413a1c53-42d9-45a6-b6dc-660d64214a8a None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:35.242117 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-413a1c53-42d9-45a6-b6dc-660d64214a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:35.305923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1400/2787] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:35.314366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd61c52-f393-491e-a1e4-1e7523b6f183 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.314838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd61c52-f393-491e-a1e4-1e7523b6f183 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.315039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd61c52-f393-491e-a1e4-1e7523b6f183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.335974 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4bd61c52-f393-491e-a1e4-1e7523b6f183 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:35.338648 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4bd61c52-f393-491e-a1e4-1e7523b6f183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:35.347906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1388/2788] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:35.352720 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a1c53-42d9-45a6-b6dc-660d64214a8a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.364574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a1c53-42d9-45a6-b6dc-660d64214a8a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.371965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.372585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.372964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.373440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.374095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:35.374424 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.376019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.388588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1401/2789] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:35.393721 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd61c52-f393-491e-a1e4-1e7523b6f183 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.403191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd61c52-f393-491e-a1e4-1e7523b6f183 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.408318 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.408987 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.409268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.409544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.410202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.412159 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.441530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1389/2790] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:35 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:12:35.446008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.452882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:35.457484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e60e0-2342-4b34-b984-25329542af48 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.520050 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.520665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.520974 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.521242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.521912 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.524069 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.549659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1402/2791] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:35 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:35.553864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.565800 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6945e79-1090-4d96-861d-78489496a0bf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.572150 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.572914 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.573186 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.573453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.574095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.575703 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.586502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1390/2792] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:35.591518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.603236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b90c80-df8c-46d5-a970-c1e10bc8baf5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.608845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00744f2-3c33-47c9-bb96-7d78d2753e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.609652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00744f2-3c33-47c9-bb96-7d78d2753e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.609983 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00744f2-3c33-47c9-bb96-7d78d2753e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.610385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00744f2-3c33-47c9-bb96-7d78d2753e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.611153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00744f2-3c33-47c9-bb96-7d78d2753e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.612832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00744f2-3c33-47c9-bb96-7d78d2753e2b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.624783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1403/2793] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:35.629156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.639739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4456e22-8aeb-4f54-9dde-586b33025000 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.645486 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.646153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.646431 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.646705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] PATH_INFO: `/v3/projects/786f8406815044c9b8ef0bb4347378ae/users/8179dff61f3a4210b337d97f407115e9/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.663994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] RBAC: Authorizing `identity:create_grant(project_id=786f8406815044c9b8ef0bb4347378ae, user_id=8179dff61f3a4210b337d97f407115e9, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.666631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.682691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1391/2794] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:35 2022] PUT /identity/v3/projects/786f8406815044c9b8ef0bb4347378ae/users/8179dff61f3a4210b337d97f407115e9/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:35.751075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.751310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.751627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.781997 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] MFA Rules not processed for user `8179dff61f3a4210b337d97f407115e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:35.783223 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:35.856665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1404/2795] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:35.868739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:35.870979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:35.937626 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fad1d2-25dd-4720-8309-2292800c553e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:35.941539 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c832b-09cc-42f0-ab3a-1725fc5c9cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:35.942143 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c832b-09cc-42f0-ab3a-1725fc5c9cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:35.942418 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c832b-09cc-42f0-ab3a-1725fc5c9cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:35.942689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c832b-09cc-42f0-ab3a-1725fc5c9cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:35.951530 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c832b-09cc-42f0-ab3a-1725fc5c9cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:35.953058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c832b-09cc-42f0-ab3a-1725fc5c9cd8 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:35.962614 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1392/2796] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:36.525550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:36.525550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:36.593373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f055f-e97d-4626-9c39-2a2bdf15bd9b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:36.599952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:36.600733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:36.601103 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:36.601386 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] PATH_INFO: `/v3/users/aa2bd36c0ca74981842828bdb55ad1ef` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:36.602743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2bd36c0ca74981842828bdb55ad1ef)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:36.604709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:36.620650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:36.665580 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2bd36c0ca74981842828bdb55ad1ef'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:36.673166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2bd36c0ca74981842828bdb55ad1ef'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:36.682337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2bd36c0ca74981842828bdb55ad1ef'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:36.683131 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2bd36c0ca74981842828bdb55ad1ef'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:36.698428 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2bd36c0ca74981842828bdb55ad1ef'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:36.706222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1405/2797] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:36 2022] DELETE /identity/v3/users/aa2bd36c0ca74981842828bdb55ad1ef => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:36.710934 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:36.711425 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:36.711521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:36.731935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:36.733191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:36.804873 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1393/2798] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:36.815721 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:36.817597 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:36.887360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc2d04-59fc-4b2d-9fb3-4deec762a16e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:36.891954 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b826-efa2-4493-b4d8-ac2f57915d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:36.892571 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b826-efa2-4493-b4d8-ac2f57915d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:36.892859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b826-efa2-4493-b4d8-ac2f57915d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:36.893151 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b826-efa2-4493-b4d8-ac2f57915d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:36.903866 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b826-efa2-4493-b4d8-ac2f57915d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:36.905497 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b826-efa2-4493-b4d8-ac2f57915d14 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:36.916290 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1406/2799] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:37.205059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.206737 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:37.219998 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ac62-70c8-45b6-a260-25eb41bae537 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:37.225585 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:37.226230 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.226505 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.226771 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] PATH_INFO: `/v3/projects/7e633c1dc48c40e3b34c4eacf76ca2f7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.227994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e633c1dc48c40e3b34c4eacf76ca2f7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:37.229971 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:37.231797 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:37.281990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e633c1dc48c40e3b34c4eacf76ca2f7', 'request_id': 'req-97381a40-c62d-4acb-b6be-7764abe568cd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:37.288493 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e633c1dc48c40e3b34c4eacf76ca2f7', 'request_id': 'req-97381a40-c62d-4acb-b6be-7764abe568cd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:37.294107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e633c1dc48c40e3b34c4eacf76ca2f7', 'request_id': 'req-97381a40-c62d-4acb-b6be-7764abe568cd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:37.308785 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] The token cache is being invalidate because project 7e633c1dc48c40e3b34c4eacf76ca2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:37.309070 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:37.309677 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97381a40-c62d-4acb-b6be-7764abe568cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:37.311409 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1394/2800] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:37 2022] DELETE /identity/v3/projects/7e633c1dc48c40e3b34c4eacf76ca2f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:37.316626 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29685fc9-95f0-408d-9cb8-238f25027e38 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.317010 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29685fc9-95f0-408d-9cb8-238f25027e38 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.317289 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29685fc9-95f0-408d-9cb8-238f25027e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.341827 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-29685fc9-95f0-408d-9cb8-238f25027e38 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:37.343043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-29685fc9-95f0-408d-9cb8-238f25027e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:37.422181 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1407/2801] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:37.433861 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72dbc-355c-4ad7-8ed9-b8c984fad2da None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.434144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72dbc-355c-4ad7-8ed9-b8c984fad2da None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.434412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72dbc-355c-4ad7-8ed9-b8c984fad2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.454663 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0dd72dbc-355c-4ad7-8ed9-b8c984fad2da None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:37.455810 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0dd72dbc-355c-4ad7-8ed9-b8c984fad2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:37.464547 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1395/2802] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:37.469492 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29685fc9-95f0-408d-9cb8-238f25027e38 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.483032 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29685fc9-95f0-408d-9cb8-238f25027e38 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:37.488169 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:37.488793 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.489078 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.489349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.489998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:37.490302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:37.491894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:37.505329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1408/2803] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:37.510985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72dbc-355c-4ad7-8ed9-b8c984fad2da None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.522262 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72dbc-355c-4ad7-8ed9-b8c984fad2da None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:37.528114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:37.529012 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.529288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.529554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.530595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:37.532638 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:37.563555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1396/2804] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:37 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:37.567973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.579304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2993-bd08-483b-880d-e31a65912763 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:37.601600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:37.644764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:37.645512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.645766 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.646096 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.646738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:37.649058 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:37.673499 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1409/2805] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:37 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:37.677877 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.690510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296a0f7-f5d4-4302-b54e-e93a0303d45b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:37.696464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:37.697108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.697366 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.697639 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.698287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:37.699943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:37.711021 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1397/2806] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:37.717129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.728560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765593-2807-47e1-8335-f56ceda44c13 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:37.734785 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c6cc8-5247-4c33-bf48-1a730c67becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:37.735372 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c6cc8-5247-4c33-bf48-1a730c67becc admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.735675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c6cc8-5247-4c33-bf48-1a730c67becc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.735962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c6cc8-5247-4c33-bf48-1a730c67becc admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.736598 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c6cc8-5247-4c33-bf48-1a730c67becc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:37.738232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c6cc8-5247-4c33-bf48-1a730c67becc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:37.750956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1410/2807] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:37.755361 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.771330 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0656d9-d28f-43b5-ba44-7f33c83527e6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:37.779698 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:37.780596 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.781044 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.781337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] PATH_INFO: `/v3/projects/784c97a538584f79a28298318be3796e/users/efaf0a263c1c49b896fddd6cd80a8a31/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.798632 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] RBAC: Authorizing `identity:create_grant(project_id=784c97a538584f79a28298318be3796e, user_id=efaf0a263c1c49b896fddd6cd80a8a31, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:37.801343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:37.816445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1398/2808] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:37 2022] PUT /identity/v3/projects/784c97a538584f79a28298318be3796e/users/efaf0a263c1c49b896fddd6cd80a8a31/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:37.827575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:37.827958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:37.828246 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:37.862799 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] MFA Rules not processed for user `efaf0a263c1c49b896fddd6cd80a8a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:37.864022 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:37.928791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1411/2809] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:37.940507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:37.942533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:38.021619 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841dad9-c412-4ba6-8d1a-abf70651448f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:38.025594 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b215b5-e65c-4387-a141-c0d792291b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:38.026102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b215b5-e65c-4387-a141-c0d792291b09 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:38.026382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b215b5-e65c-4387-a141-c0d792291b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:38.026645 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b215b5-e65c-4387-a141-c0d792291b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:38.035631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b215b5-e65c-4387-a141-c0d792291b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:38.037088 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b215b5-e65c-4387-a141-c0d792291b09 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:38.047860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1399/2810] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:38.574921 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:38.576582 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:38.646029 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04e78c-4905-48e6-92b3-d94a785ff4d3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:38.650988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:38.651656 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:38.651937 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:38.652231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] PATH_INFO: `/v3/users/8179dff61f3a4210b337d97f407115e9` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:38.653441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8179dff61f3a4210b337d97f407115e9)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:38.655373 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:38.698444 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:38.713206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8179dff61f3a4210b337d97f407115e9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:38.721155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8179dff61f3a4210b337d97f407115e9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:38.730202 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8179dff61f3a4210b337d97f407115e9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:38.730902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8179dff61f3a4210b337d97f407115e9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:38.744630 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8179dff61f3a4210b337d97f407115e9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:38.752768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1412/2811] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:38 2022] DELETE /identity/v3/users/8179dff61f3a4210b337d97f407115e9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:38.757533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:38.758000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:38.758113 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:38.778531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:38.779799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:38.806138 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:38.846965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1400/2812] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:38.857054 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:38.858602 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:38.917945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b49c3d-9aa1-432e-96d4-fc1febab3881 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:38.921742 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:38.922490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:38.922900 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:38.923074 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:38.932326 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:38.933830 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:38.943408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1413/2813] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:39.144080 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:39.146031 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:39.158628 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d0d0-9066-4d6e-9c60-92a8f04b85f3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:39.163702 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:39.164399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:39.164745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:39.165108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] PATH_INFO: `/v3/users/44903f9c97314026943154d3561bcc7f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:39.166314 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44903f9c97314026943154d3561bcc7f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:39.168323 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:39.220920 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44903f9c97314026943154d3561bcc7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.229984 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:39.231443 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:39.238588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44903f9c97314026943154d3561bcc7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.245220 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855ed9d-b2ad-4290-9cda-9da4d29f2929 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:39.246635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44903f9c97314026943154d3561bcc7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.247401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44903f9c97314026943154d3561bcc7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.248209 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f13b64d6-5f6b-4946-8090-720d2ee4a67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44903f9c97314026943154d3561bcc7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.250537 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:39.251621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:39.251967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:39.252309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] PATH_INFO: `/v3/projects/786f8406815044c9b8ef0bb4347378ae` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:39.253755 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] RBAC: Authorizing `identity:delete_project(project_id=786f8406815044c9b8ef0bb4347378ae)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:39.255773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:39.263890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1401/2814] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:39 2022] DELETE /identity/v3/users/44903f9c97314026943154d3561bcc7f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:39.268190 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:39.268722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:39.268722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:39.287634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:39.289041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:39.307293 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786f8406815044c9b8ef0bb4347378ae', 'request_id': 'req-dd1861cb-b641-4620-8873-1cd153ca698d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.313561 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786f8406815044c9b8ef0bb4347378ae', 'request_id': 'req-dd1861cb-b641-4620-8873-1cd153ca698d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.321713 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786f8406815044c9b8ef0bb4347378ae', 'request_id': 'req-dd1861cb-b641-4620-8873-1cd153ca698d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.335600 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] The token cache is being invalidate because project 786f8406815044c9b8ef0bb4347378ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:39.336023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.336686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.338218 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1414/2815] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:39 2022] DELETE /identity/v3/projects/786f8406815044c9b8ef0bb4347378ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:39.352513 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1402/2816] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:39.363132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:39.364585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:39.416449 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:39.444581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1861cb-b641-4620-8873-1cd153ca698d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:39.451887 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8703a9-f604-4905-a9a2-32ff4d319821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:39.452528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8703a9-f604-4905-a9a2-32ff4d319821 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:39.452836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8703a9-f604-4905-a9a2-32ff4d319821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:39.453672 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8703a9-f604-4905-a9a2-32ff4d319821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:39.524964 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8703a9-f604-4905-a9a2-32ff4d319821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:39.526496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8703a9-f604-4905-a9a2-32ff4d319821 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:39.538448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1415/2817] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:39.908790 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:39.910392 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:39.922905 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d06a18-93e4-4cf2-881b-894fa2015f01 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:39.927545 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:39.928207 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:39.928485 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:39.928755 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] PATH_INFO: `/v3/projects/7897e249691b4112b157e838978cbffb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:39.930146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7897e249691b4112b157e838978cbffb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:39.932615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:39.978557 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:39.989939 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7897e249691b4112b157e838978cbffb', 'request_id': 'req-41db004c-ddc8-4d67-83bf-82814263b256'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:39.996670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7897e249691b4112b157e838978cbffb', 'request_id': 'req-41db004c-ddc8-4d67-83bf-82814263b256'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:40.003581 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7897e249691b4112b157e838978cbffb', 'request_id': 'req-41db004c-ddc8-4d67-83bf-82814263b256'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:40.018980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] The token cache is being invalidate because project 7897e249691b4112b157e838978cbffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:40.019265 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:40.019901 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41db004c-ddc8-4d67-83bf-82814263b256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:40.021471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1403/2818] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:39 2022] DELETE /identity/v3/projects/7897e249691b4112b157e838978cbffb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:40.026986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7d41d-920d-4d73-af23-051b7c0e0248 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.027510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7d41d-920d-4d73-af23-051b7c0e0248 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.027510 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7d41d-920d-4d73-af23-051b7c0e0248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.048627 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c3e7d41d-920d-4d73-af23-051b7c0e0248 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:40.049888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c3e7d41d-920d-4d73-af23-051b7c0e0248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:40.112079 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1416/2819] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:40.121446 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463363b4-4671-4e59-a36c-6808629f9ad8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.121787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463363b4-4671-4e59-a36c-6808629f9ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.122065 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463363b4-4671-4e59-a36c-6808629f9ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.145127 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-463363b4-4671-4e59-a36c-6808629f9ad8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:40.146354 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-463363b4-4671-4e59-a36c-6808629f9ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:40.155235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1404/2820] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:40.160638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7d41d-920d-4d73-af23-051b7c0e0248 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:40.171544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7d41d-920d-4d73-af23-051b7c0e0248 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:40.177986 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:40.178596 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.178869 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.179119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.179779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:40.180075 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:40.181696 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:40.194516 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1417/2821] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:40.199605 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463363b4-4671-4e59-a36c-6808629f9ad8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:40.213972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463363b4-4671-4e59-a36c-6808629f9ad8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:40.221999 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:40.222603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.222878 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.223146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.223794 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:40.225775 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:40.261500 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1405/2822] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:40 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:12:40.266843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:40.278062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152a007-7715-44b1-a481-923492cca68d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:40.338462 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:40.339084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.339363 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.339638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.340310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:40.342573 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:40.366661 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1418/2823] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:40 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:40.371266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:40.382424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76a180-aebe-432e-8252-3d8069f5a737 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:40.388294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:40.389161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.389452 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.389856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.390699 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:40.392694 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:40.405214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1406/2824] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:40.411577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:40.417686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:40.425801 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd85aba-9d74-4ed7-a176-fdaef44ed37a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:40.431242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240bd18-216b-4783-b2b1-03f8e934d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:40.431929 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240bd18-216b-4783-b2b1-03f8e934d68a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.432205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240bd18-216b-4783-b2b1-03f8e934d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.432498 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240bd18-216b-4783-b2b1-03f8e934d68a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.433203 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240bd18-216b-4783-b2b1-03f8e934d68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:40.434782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240bd18-216b-4783-b2b1-03f8e934d68a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:40.446590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1419/2825] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:40.451218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:40.462347 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710838-d34d-4053-9255-7c5ca3922ff9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:40.468625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:40.469304 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.469583 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.470337 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] PATH_INFO: `/v3/projects/0e0b250cf7f84170a4c4e7d866915a62/users/04b9e7e7403f4c8291be10f81f7ebffc/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.487075 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0b250cf7f84170a4c4e7d866915a62, user_id=04b9e7e7403f4c8291be10f81f7ebffc, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:40.489750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:40.506510 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1407/2826] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:40 2022] PUT /identity/v3/projects/0e0b250cf7f84170a4c4e7d866915a62/users/04b9e7e7403f4c8291be10f81f7ebffc/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:40.512610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.513163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.513655 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.542701 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:40.544113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:40.611933 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1420/2827] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:40.622130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:40.624106 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:40.706093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935a8e5-0077-4029-bc51-a80b1b00a9a5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:40.712400 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97c245-20c7-4278-a90d-c383ebd5238e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:40.713325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c245-20c7-4278-a90d-c383ebd5238e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:40.713695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c245-20c7-4278-a90d-c383ebd5238e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:40.714049 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c245-20c7-4278-a90d-c383ebd5238e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:40.727102 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c245-20c7-4278-a90d-c383ebd5238e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:40.728543 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c245-20c7-4278-a90d-c383ebd5238e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:40.738567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1408/2828] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:42.378973 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:42.380429 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:42.445134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3995cd-2aba-476b-9982-414309ca8de1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:42.448822 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:42.449445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:42.449783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:42.450055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:42.452062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:42.531646 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:42.533235 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:42.544861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1421/2829] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:45.295692 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a1ab-4faa-4eef-b3ed-f5dff8ff354f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:45.296220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a1ab-4faa-4eef-b3ed-f5dff8ff354f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:45.296324 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a1ab-4faa-4eef-b3ed-f5dff8ff354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:45.329893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4ec0a1ab-4faa-4eef-b3ed-f5dff8ff354f None None] MFA Rules not processed for user `04b9e7e7403f4c8291be10f81f7ebffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:45.331291 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4ec0a1ab-4faa-4eef-b3ed-f5dff8ff354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:45.392156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:45.405673 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1409/2830] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:45.410439 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:45.421342 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7449427-5fc7-4839-b5b7-7ec655641050 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:45.426261 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:45.426876 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:45.427153 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:45.427455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:45.428090 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:45.430027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:45.477021 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1422/2831] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:45 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:45.480333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a1ab-4faa-4eef-b3ed-f5dff8ff354f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:45.492268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a1ab-4faa-4eef-b3ed-f5dff8ff354f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:45.559496 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:45.560296 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:45.560422 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:45.560651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:45.561363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:45.563335 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:45.587123 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1410/2832] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:45 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:45.591621 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:45.602313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5ee9-5df9-4dc5-8dd0-3f4a66f22757 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:45.620166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:45.621456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:45.621733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:45.623126 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:45.624023 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:45.626252 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:45.631894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:45.641901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1423/2833] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:45.642868 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:45.653830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ef948-33bd-4533-a773-871423f13738 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:45.658846 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:45.659548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:45.659828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:45.660099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] PATH_INFO: `/v3/projects/b6c3d583120444fda7b59365a3e7eee5/users/73aa3497d917485896fe7d5fcadcf43c/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:45.676171 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c3d583120444fda7b59365a3e7eee5, user_id=73aa3497d917485896fe7d5fcadcf43c, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:45.678924 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:45.694597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1411/2834] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:45 2022] PUT /identity/v3/projects/b6c3d583120444fda7b59365a3e7eee5/users/73aa3497d917485896fe7d5fcadcf43c/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:45.698989 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:45.710455 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1fc0-bbdb-4c49-ae05-10658df4669e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:45.774063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:45.774693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:45.774952 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:45.775222 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:45.775858 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:45.777512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:45.788453 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1424/2835] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:12:45.793453 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:45.804650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bcf00-3b00-4944-b316-7647049bd2be admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:45.809886 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262d3c-f7da-4694-a940-859d0a5ef145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:45.810473 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262d3c-f7da-4694-a940-859d0a5ef145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:45.810750 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262d3c-f7da-4694-a940-859d0a5ef145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:45.811019 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262d3c-f7da-4694-a940-859d0a5ef145 admin admin] PATH_INFO: `/v3/projects/b6c3d583120444fda7b59365a3e7eee5/users/73aa3497d917485896fe7d5fcadcf43c/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:45.812954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e262d3c-f7da-4694-a940-859d0a5ef145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c3d583120444fda7b59365a3e7eee5, user_id=73aa3497d917485896fe7d5fcadcf43c, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:45.815588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e262d3c-f7da-4694-a940-859d0a5ef145 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:45.828319 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1412/2836] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:45 2022] PUT /identity/v3/projects/b6c3d583120444fda7b59365a3e7eee5/users/73aa3497d917485896fe7d5fcadcf43c/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:12:47.050452 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:47.052362 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:47.067710 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb25c-f25a-47af-bdbe-3dd737a35bce admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:47.151943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:47.152782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:47.153271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:47.153545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] PATH_INFO: `/v3/users/efaf0a263c1c49b896fddd6cd80a8a31` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:47.154882 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] RBAC: Authorizing `identity:delete_user(user_id=efaf0a263c1c49b896fddd6cd80a8a31)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:47.157213 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:47.232741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efaf0a263c1c49b896fddd6cd80a8a31'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:47.243527 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efaf0a263c1c49b896fddd6cd80a8a31'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:47.257536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efaf0a263c1c49b896fddd6cd80a8a31'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:47.258278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efaf0a263c1c49b896fddd6cd80a8a31'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:47.278239 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efaf0a263c1c49b896fddd6cd80a8a31'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:47.286019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1425/2837] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:47 2022] DELETE /identity/v3/users/efaf0a263c1c49b896fddd6cd80a8a31 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:47.292383 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:47.293445 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:47.293869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:47.319105 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:47.320519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:47.393927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1413/2838] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:47.409780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:47.412337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:47.471225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:47.550782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52f24f-3bf6-4efa-836c-ec59875a27be admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:47.555966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990dbd2-e6b3-40cd-bf9a-9e25034d4ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:47.556915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990dbd2-e6b3-40cd-bf9a-9e25034d4ebe service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:47.557434 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990dbd2-e6b3-40cd-bf9a-9e25034d4ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:47.558483 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990dbd2-e6b3-40cd-bf9a-9e25034d4ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:47.580334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990dbd2-e6b3-40cd-bf9a-9e25034d4ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:47.581902 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990dbd2-e6b3-40cd-bf9a-9e25034d4ebe service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:47.596370 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1426/2839] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:48.183273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:48.185634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:48.231713 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8815-b4da-4a32-82f3-ef1e8b4ffa2b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:48.251679 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:48.252523 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.252965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.253266 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] PATH_INFO: `/v3/projects/784c97a538584f79a28298318be3796e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.254561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784c97a538584f79a28298318be3796e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:48.256675 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:48.325391 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:48.333430 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784c97a538584f79a28298318be3796e', 'request_id': 'req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:48.349081 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784c97a538584f79a28298318be3796e', 'request_id': 'req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:48.358533 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784c97a538584f79a28298318be3796e', 'request_id': 'req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:48.381892 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] The token cache is being invalidate because project 784c97a538584f79a28298318be3796e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:48.382353 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:48.383141 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1b3cad0-501a-4aaf-a23d-fea99c1a7b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:48.385267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1414/2840] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:48 2022] DELETE /identity/v3/projects/784c97a538584f79a28298318be3796e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:48.390082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f0c3-bb70-490b-b401-cd40cf9b6e5f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.390690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f0c3-bb70-490b-b401-cd40cf9b6e5f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.390690 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362f0c3-bb70-490b-b401-cd40cf9b6e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.424971 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e362f0c3-bb70-490b-b401-cd40cf9b6e5f None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:48.426242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e362f0c3-bb70-490b-b401-cd40cf9b6e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:48.498903 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1427/2841] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:48.507286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b401f-5fbe-4d1d-9b96-31fc7c05fcda None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.507572 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b401f-5fbe-4d1d-9b96-31fc7c05fcda None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.507843 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b401f-5fbe-4d1d-9b96-31fc7c05fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.533151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fb8b401f-5fbe-4d1d-9b96-31fc7c05fcda None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:48.535490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb8b401f-5fbe-4d1d-9b96-31fc7c05fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:48.546967 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1415/2842] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:48.551536 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362f0c3-bb70-490b-b401-cd40cf9b6e5f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:48.563786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362f0c3-bb70-490b-b401-cd40cf9b6e5f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:48.569955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:48.570873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.571228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.571590 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.572360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:48.572733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:48.574479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:48.593780 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1428/2843] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:12:48.595802 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b401f-5fbe-4d1d-9b96-31fc7c05fcda None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:48.607278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b401f-5fbe-4d1d-9b96-31fc7c05fcda None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:48.613962 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:48.614941 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.615525 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.616008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.616884 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:48.619269 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:48.658327 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1416/2844] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:48 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:48.662736 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:48.674265 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dcaf4-13df-4c7a-8eb4-723de9c25774 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:48.789318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:48.789967 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.790244 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.790654 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.791314 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:48.793433 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:48.829549 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:48.837414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1429/2845] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:48 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:12:48.852848 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283f667-9cec-40a4-bb7f-7bc89f1065c5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:48.864090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:48.864276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.864464 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.864687 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.865544 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:48.867570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:48.892572 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:48.904124 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1417/2846] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:48.904385 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc41c2-35f2-4dd1-85a1-12fd7e3046a4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:48.910132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437538d-438f-4b2c-8468-75ad5abf9d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:48.910958 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437538d-438f-4b2c-8468-75ad5abf9d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.911304 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437538d-438f-4b2c-8468-75ad5abf9d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.911577 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437538d-438f-4b2c-8468-75ad5abf9d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.912225 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437538d-438f-4b2c-8468-75ad5abf9d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:48.915485 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437538d-438f-4b2c-8468-75ad5abf9d92 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:48.934027 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:48.940197 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1430/2847] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:12:48.944497 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2326c35-2430-480f-88fa-5a4b1b4a1ce7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:48.949700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:48.950836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:48.950836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:48.951176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] PATH_INFO: `/v3/projects/f253dc4db26d473abb303205ef900814/users/3933f606195b41f39319885477711021/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:48.971220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f253dc4db26d473abb303205ef900814, user_id=3933f606195b41f39319885477711021, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:48.973847 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:49.000251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1418/2848] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:48 2022] PUT /identity/v3/projects/f253dc4db26d473abb303205ef900814/users/3933f606195b41f39319885477711021/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:49.002575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:49.002923 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:49.003242 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:49.050650 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] MFA Rules not processed for user `3933f606195b41f39319885477711021`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:49.052176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:49.079653 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:49.166645 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1431/2849] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:49.180275 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:49.182061 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:49.308708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831f602-18e4-4fc8-b63a-576ab81205e7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:49.315162 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:49.315494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:49.315784 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:49.316039 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:49.324946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:49.335561 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:49.348898 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1419/2850] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:49.550966 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:49.552595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:49.716179 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7429d-9745-4c55-b0aa-1f79bb2519f8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:49.725070 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a928d8-bf06-4ca7-bb3e-b39b2009cbae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:49.728332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a928d8-bf06-4ca7-bb3e-b39b2009cbae service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:49.728679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a928d8-bf06-4ca7-bb3e-b39b2009cbae service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:49.729724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a928d8-bf06-4ca7-bb3e-b39b2009cbae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:49.742945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-70a928d8-bf06-4ca7-bb3e-b39b2009cbae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:49.776143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a928d8-bf06-4ca7-bb3e-b39b2009cbae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:49.783810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a928d8-bf06-4ca7-bb3e-b39b2009cbae service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:49.805544 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1432/2851] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:49.958977 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:50.077792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:50.118201 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da1177-e3ba-4c28-9cc0-a72e695e18a9 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:50.131356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:50.132620 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:50.139299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:50.139631 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] PATH_INFO: `/v3/users/3933f606195b41f39319885477711021` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:50.143294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3933f606195b41f39319885477711021)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:50.146621 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:50.242454 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3933f606195b41f39319885477711021'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:50.274646 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3933f606195b41f39319885477711021'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:50.295224 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3933f606195b41f39319885477711021'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:50.299160 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3933f606195b41f39319885477711021'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:50.302881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3933f606195b41f39319885477711021'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:50.332672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1420/2852] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:12:49 2022] DELETE /identity/v3/users/3933f606195b41f39319885477711021 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:50.338481 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:50.339945 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:50.340779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:50.395183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:50.398089 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:50.504334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1433/2853] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:50.517761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:50.519261 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:50.594754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9178e-7708-4042-bf5f-a05b44a307a4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:50.598887 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8f127-1850-49cd-8312-07c5e174a197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:50.599563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8f127-1850-49cd-8312-07c5e174a197 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:50.599921 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8f127-1850-49cd-8312-07c5e174a197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:50.600278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8f127-1850-49cd-8312-07c5e174a197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:50.618346 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8f127-1850-49cd-8312-07c5e174a197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:50.620084 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8f127-1850-49cd-8312-07c5e174a197 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:50.632516 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1421/2854] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:50.979809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:50.983955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:51.036425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26068db-52de-4af2-9bfb-f9e382989687 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.049243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.050027 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.050336 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.052832 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] PATH_INFO: `/v3/projects/f253dc4db26d473abb303205ef900814` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.054121 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f253dc4db26d473abb303205ef900814)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.056068 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.129649 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f253dc4db26d473abb303205ef900814', 'request_id': 'req-5418c23a-2061-4f99-a7a1-3799511d0c9e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:51.135307 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:51.147623 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f253dc4db26d473abb303205ef900814', 'request_id': 'req-5418c23a-2061-4f99-a7a1-3799511d0c9e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:51.163947 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f253dc4db26d473abb303205ef900814', 'request_id': 'req-5418c23a-2061-4f99-a7a1-3799511d0c9e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:51.181663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] The token cache is being invalidate because project f253dc4db26d473abb303205ef900814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:12:51.181998 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:51.182664 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5418c23a-2061-4f99-a7a1-3799511d0c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:12:51.184389 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1434/2855] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:12:50 2022] DELETE /identity/v3/projects/f253dc4db26d473abb303205ef900814 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:51.190114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f9fb-47c7-4150-8ed1-60f61043dacc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.190419 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f9fb-47c7-4150-8ed1-60f61043dacc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.190671 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f9fb-47c7-4150-8ed1-60f61043dacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.213554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8454f9fb-47c7-4150-8ed1-60f61043dacc None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:51.214997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8454f9fb-47c7-4150-8ed1-60f61043dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:51.291992 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1422/2856] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:51.300364 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b9102-7918-4475-b650-5f79da3e2fec None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.301231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b9102-7918-4475-b650-5f79da3e2fec None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.302042 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b9102-7918-4475-b650-5f79da3e2fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.323876 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.324267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.324602 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.331570 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8e8b9102-7918-4475-b650-5f79da3e2fec None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:51.332908 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8e8b9102-7918-4475-b650-5f79da3e2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:51.352851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1435/2857] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:51.357845 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b9102-7918-4475-b650-5f79da3e2fec None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.358507 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:51.363399 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] MFA Rules not processed for user `73aa3497d917485896fe7d5fcadcf43c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:51.365002 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:51.373459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b9102-7918-4475-b650-5f79da3e2fec None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.379163 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.379784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.380888 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.381172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.381837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:12:51.382142 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.383778 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.401234 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1436/2858] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:12:51.403292 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.415901 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eeeef-eab9-4d80-8c57-f1cef7b4b669 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.422229 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.422854 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.423132 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.423407 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.424047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.426770 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.468615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1437/2859] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:12:51.475809 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.494041 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1423/2860] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:51.495243 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.496864 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:51.561348 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77374-0eef-4fdf-88c5-5d98fe425970 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.567889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.568708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.569160 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.569435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.570081 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.572128 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.601487 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e552bc-b813-46ab-9bb4-894d0e66037c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.603881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1438/2861] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:51.607686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.621748 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e6a1-fec4-466f-808a-d03c8e29a392 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.627531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.628651 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.629112 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.629642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.632414 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.634531 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.647733 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1439/2862] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:12:51.651466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.664635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecee29-8695-4a9e-b459-dd9dbeeb6497 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.669774 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.670517 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.670889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.671399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.672216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.674152 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.676254 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0449abfbe044b3aff4f24a5f1b7b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.677334 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.677666 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.678030 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.680144 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:51.689851 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1440/2863] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:51.691318 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.705014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33b26-d9fd-4480-b6fb-2f623aad6f3a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.710679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d68bdd-b002-48fd-a245-63a48bd4ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:51.711495 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68bdd-b002-48fd-a245-63a48bd4ee29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.712055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68bdd-b002-48fd-a245-63a48bd4ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.712526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68bdd-b002-48fd-a245-63a48bd4ee29 admin admin] PATH_INFO: `/v3/projects/e81a725155094a9d9e76539b35931aec/users/f90f29f5f7da4651a79bc3ff0986f81b/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.729629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d68bdd-b002-48fd-a245-63a48bd4ee29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81a725155094a9d9e76539b35931aec, user_id=f90f29f5f7da4651a79bc3ff0986f81b, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.732790 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d68bdd-b002-48fd-a245-63a48bd4ee29 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.766545 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1441/2864] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:51 2022] PUT /identity/v3/projects/e81a725155094a9d9e76539b35931aec/users/f90f29f5f7da4651a79bc3ff0986f81b/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:51.768825 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:51.769130 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb105-02b2-4c8d-99e7-7d6e3991798f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.769794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb105-02b2-4c8d-99e7-7d6e3991798f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.769794 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb105-02b2-4c8d-99e7-7d6e3991798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:51.772751 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:51.776360 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:51.788004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1424/2865] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:51.817932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e06fb105-02b2-4c8d-99e7-7d6e3991798f None None] MFA Rules not processed for user `f90f29f5f7da4651a79bc3ff0986f81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:51.819360 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e06fb105-02b2-4c8d-99e7-7d6e3991798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:51.862891 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:51.917349 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1442/2866] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:12:51.921860 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:51.934554 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09086dbf-4449-4458-9204-821a8eef3b3a service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:51.944135 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:51.944435 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:51.944738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.002412 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.003053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.003333 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.003607 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.004504 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.006217 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.009764 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:52.011134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:52.050077 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1425/2867] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:52.051956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.100962 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1443/2868] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:52.137550 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f5c0-0e3c-4a61-b713-06f42ae7e24e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.142849 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.147494 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.148052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.148831 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.150352 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.152415 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.164119 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.165761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:52.186734 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1426/2869] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:12:52 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:12:52.190990 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.201286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95c2d-7643-4ffb-959e-bbd56ae1bf77 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.210979 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.211582 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.211856 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.212205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.213011 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.214661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.236149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1427/2870] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:12:52.240866 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.251676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73726d4e-0dc0-499c-86c2-6d11e2b141bf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.256662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.257432 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.257708 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.257980 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] PATH_INFO: `/v3/projects/e39901b3856449b68c7a358abc13328d/users/60aa5f8d12194b1797dd6e6a13681f5e/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.270791 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571316c-16b2-400b-ac62-0389145281b8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.277294 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39901b3856449b68c7a358abc13328d, user_id=60aa5f8d12194b1797dd6e6a13681f5e, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.279961 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.295705 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1428/2871] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:52 2022] PUT /identity/v3/projects/e39901b3856449b68c7a358abc13328d/users/60aa5f8d12194b1797dd6e6a13681f5e/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:52.299891 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.302105 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:52.337267 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:52.345610 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9b95-5053-4508-8375-f239bd511a6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.346255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9b95-5053-4508-8375-f239bd511a6f service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.346538 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9b95-5053-4508-8375-f239bd511a6f service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.346810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9b95-5053-4508-8375-f239bd511a6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.370738 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cec48-189f-467c-a240-c24e1463ee51 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.375467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.376218 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.376577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.376906 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.377495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.379191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.390032 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1429/2872] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:12:52.394258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.406946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390df18-bdf4-4850-b243-fe019cf8cf70 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.408262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9b95-5053-4508-8375-f239bd511a6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.410324 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9b95-5053-4508-8375-f239bd511a6f service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.412292 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.412995 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.413272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.413541 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] PATH_INFO: `/v3/projects/e39901b3856449b68c7a358abc13328d/users/60aa5f8d12194b1797dd6e6a13681f5e/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.415502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39901b3856449b68c7a358abc13328d, user_id=60aa5f8d12194b1797dd6e6a13681f5e, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.418185 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.420400 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1444/2873] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:12:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:12:52.429756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1430/2874] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:12:52 2022] PUT /identity/v3/projects/e39901b3856449b68c7a358abc13328d/users/60aa5f8d12194b1797dd6e6a13681f5e/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:12:52.440309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baaa49-14df-47a3-85a7-0d81f673a874 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.440594 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baaa49-14df-47a3-85a7-0d81f673a874 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.440926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baaa49-14df-47a3-85a7-0d81f673a874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.481194 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-13baaa49-14df-47a3-85a7-0d81f673a874 None None] MFA Rules not processed for user `60aa5f8d12194b1797dd6e6a13681f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:52.482413 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-13baaa49-14df-47a3-85a7-0d81f673a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:52.582782 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1445/2875] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:52.590570 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.592531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:52.674756 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402daef-530c-466d-bc32-f726999b334f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.679047 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.679662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.679944 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.689943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.702954 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.704832 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.718830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1431/2876] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:52.823730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baaa49-14df-47a3-85a7-0d81f673a874 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:52.840408 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baaa49-14df-47a3-85a7-0d81f673a874 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:52.846427 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a4d06-da60-4f3f-9279-a6dc13b44ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:52.847243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4d06-da60-4f3f-9279-a6dc13b44ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:52.847617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4d06-da60-4f3f-9279-a6dc13b44ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:52.847968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a4d06-da60-4f3f-9279-a6dc13b44ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:52.925014 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:52.937761 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a4d06-da60-4f3f-9279-a6dc13b44ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:52.939519 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a4d06-da60-4f3f-9279-a6dc13b44ba9 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:52.950792 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1446/2877] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:00.386782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.468985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e18fc-7729-446b-9a10-a38e52cf169c service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.474588 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.475393 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.475769 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.476135 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] PATH_INFO: `/v3/users/f90f29f5f7da4651a79bc3ff0986f81b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.477495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90f29f5f7da4651a79bc3ff0986f81b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.479577 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.545215 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90f29f5f7da4651a79bc3ff0986f81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:00.555780 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:00.562287 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90f29f5f7da4651a79bc3ff0986f81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:00.572119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90f29f5f7da4651a79bc3ff0986f81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:00.573042 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90f29f5f7da4651a79bc3ff0986f81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:00.574164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90f29f5f7da4651a79bc3ff0986f81b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:00.597278 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1432/2878] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:00 2022] DELETE /identity/v3/users/f90f29f5f7da4651a79bc3ff0986f81b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:00.610898 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.611459 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.611663 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.660932 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:00.662382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:00.728679 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1447/2879] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:00.738852 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:00.740420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:00.821082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f638-72c2-4c3d-9067-2578408e715e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:00.825612 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:00.826239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:00.826518 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:00.826787 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:00.837519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:00.839004 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:00.850536 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1433/2880] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:01.162141 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.164159 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.179686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004de5ab-e3f0-4d12-9364-b243adeb3b3d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.185518 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.186176 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.186559 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.186833 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] PATH_INFO: `/v3/projects/e81a725155094a9d9e76539b35931aec` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.188999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81a725155094a9d9e76539b35931aec)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.190262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.252330 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81a725155094a9d9e76539b35931aec', 'request_id': 'req-8997f65a-befd-42fe-80a3-266c5e98b307'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.258687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81a725155094a9d9e76539b35931aec', 'request_id': 'req-8997f65a-befd-42fe-80a3-266c5e98b307'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.270683 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81a725155094a9d9e76539b35931aec', 'request_id': 'req-8997f65a-befd-42fe-80a3-266c5e98b307'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.282739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] The token cache is being invalidate because project e81a725155094a9d9e76539b35931aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:01.283093 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.283783 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8997f65a-befd-42fe-80a3-266c5e98b307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.285393 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1448/2881] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:01 2022] DELETE /identity/v3/projects/e81a725155094a9d9e76539b35931aec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.289603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.300205 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9d05c-5950-4635-a05f-03a58fb6e108 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.331768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.332086 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.332332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.352709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] MFA Rules not processed for user `04b9e7e7403f4c8291be10f81f7ebffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:01.353946 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.366472 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.367108 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.367385 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.367653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] PATH_INFO: `/v3/users/60aa5f8d12194b1797dd6e6a13681f5e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.368815 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60aa5f8d12194b1797dd6e6a13681f5e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.370730 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:01.413844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1449/2882] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:01.429434 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60aa5f8d12194b1797dd6e6a13681f5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.442090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60aa5f8d12194b1797dd6e6a13681f5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.452082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60aa5f8d12194b1797dd6e6a13681f5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.452788 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60aa5f8d12194b1797dd6e6a13681f5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.453902 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-08032c80-3379-4e39-a5cc-3204c6f1bca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60aa5f8d12194b1797dd6e6a13681f5e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:01.458401 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.470729 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1434/2883] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:01 2022] DELETE /identity/v3/users/60aa5f8d12194b1797dd6e6a13681f5e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:01.901095 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:01.902629 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:01.919008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ed712-f237-4557-8f09-39bf7cd6f25c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:01.938802 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:01.985963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:01.986700 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:01.987044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:01.987381 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] PATH_INFO: `/v3/projects/e39901b3856449b68c7a358abc13328d` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:01.988717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39901b3856449b68c7a358abc13328d)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:01.990811 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.040164 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39901b3856449b68c7a358abc13328d', 'request_id': 'req-1e16f0f0-6cb0-496a-be9e-c533d6119caa'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:02.046465 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39901b3856449b68c7a358abc13328d', 'request_id': 'req-1e16f0f0-6cb0-496a-be9e-c533d6119caa'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:02.055451 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39901b3856449b68c7a358abc13328d', 'request_id': 'req-1e16f0f0-6cb0-496a-be9e-c533d6119caa'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:02.067872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] The token cache is being invalidate because project e39901b3856449b68c7a358abc13328d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:02.068271 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:02.069030 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1e16f0f0-6cb0-496a-be9e-c533d6119caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:02.070533 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1450/2884] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:01 2022] DELETE /identity/v3/projects/e39901b3856449b68c7a358abc13328d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:02.075469 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ca50-4d36-4be0-aa38-0923a28de4c8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.075749 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ca50-4d36-4be0-aa38-0923a28de4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.076017 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ca50-4d36-4be0-aa38-0923a28de4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.096630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7da1ca50-4d36-4be0-aa38-0923a28de4c8 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:02.097869 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7da1ca50-4d36-4be0-aa38-0923a28de4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:02.166538 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1435/2885] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:02.174698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65da7e-e319-40e5-9f3b-e45487a94051 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.175003 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65da7e-e319-40e5-9f3b-e45487a94051 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.175272 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65da7e-e319-40e5-9f3b-e45487a94051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.196676 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cc65da7e-e319-40e5-9f3b-e45487a94051 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:02.197944 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cc65da7e-e319-40e5-9f3b-e45487a94051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:02.206652 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1451/2886] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:02.211235 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1ca50-4d36-4be0-aa38-0923a28de4c8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.222037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1ca50-4d36-4be0-aa38-0923a28de4c8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.227660 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.228257 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.228531 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.228844 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.229461 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:02.229761 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.231356 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.246676 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1436/2887] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:02.253525 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65da7e-e319-40e5-9f3b-e45487a94051 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.267872 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65da7e-e319-40e5-9f3b-e45487a94051 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.273838 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.274442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.274712 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.274975 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.275595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.277526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.310305 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1452/2888] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:02.315841 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.331358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0efa-0699-46b4-b1fd-f54545712c5d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.395502 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.396051 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.396389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.396874 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.397556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.399881 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.423683 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1437/2889] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:02.428076 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.439113 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da886b3-2a9c-4f68-8248-0b0b3f223cef admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.444388 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.445002 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.445276 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.445540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.446182 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.447871 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.459311 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1453/2890] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:02.463862 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.474753 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a101e-0295-4927-9f4f-a4213f107574 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.480179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d814bb9-d30b-4be0-87d8-c216f5562a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.480839 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814bb9-d30b-4be0-87d8-c216f5562a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.481098 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814bb9-d30b-4be0-87d8-c216f5562a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.481364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814bb9-d30b-4be0-87d8-c216f5562a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.482003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d814bb9-d30b-4be0-87d8-c216f5562a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.483608 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d814bb9-d30b-4be0-87d8-c216f5562a12 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.496174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1438/2891] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:02.501041 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.511985 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6992b-ae75-446c-afa5-edeb54bb5a4f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.517846 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.518500 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.518773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.519045 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] PATH_INFO: `/v3/projects/55b20212981a48398f4ffeb089d9dd25/users/595bbdfb46444ed1995d3bd4090a104b/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.535507 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b20212981a48398f4ffeb089d9dd25, user_id=595bbdfb46444ed1995d3bd4090a104b, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.538199 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.554262 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1454/2892] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:02 2022] PUT /identity/v3/projects/55b20212981a48398f4ffeb089d9dd25/users/595bbdfb46444ed1995d3bd4090a104b/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:02.569213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0866a0-cf51-4312-8dd6-654eaf775a2b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.569490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0866a0-cf51-4312-8dd6-654eaf775a2b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.569752 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0866a0-cf51-4312-8dd6-654eaf775a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.599477 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5b0866a0-cf51-4312-8dd6-654eaf775a2b None None] MFA Rules not processed for user `595bbdfb46444ed1995d3bd4090a104b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:02.600739 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b0866a0-cf51-4312-8dd6-654eaf775a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:02.651744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:02.672865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1439/2893] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:02.678730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.730862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:02.747479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640d93a-da1d-4c1e-aa39-945dd7526204 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.753770 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.754399 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.754680 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.754951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.755585 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.757609 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.790425 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1455/2894] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:02.795653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0866a0-cf51-4312-8dd6-654eaf775a2b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.808562 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0866a0-cf51-4312-8dd6-654eaf775a2b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.879350 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.879972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.880251 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.880519 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.881204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.883151 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.909074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1440/2895] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:02 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:13:02.916268 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.929315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578550a-d750-4863-bf9b-63f1a5e5dc56 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.934440 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.935043 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.935299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.935565 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.936196 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.937817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:02.949221 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1456/2896] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:02.953574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:02.964700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd687f-d0e4-4722-b116-7aac6a1625a5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:02.970506 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:02.971202 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:02.971511 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:02.971776 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] PATH_INFO: `/v3/projects/d27e82e57ecb4829a6c9a42fb7702a78/users/3b5ed0b08e03411981230295b6f36e92/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:02.987956 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27e82e57ecb4829a6c9a42fb7702a78, user_id=3b5ed0b08e03411981230295b6f36e92, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:02.990653 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.007386 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1441/2897] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:02 2022] PUT /identity/v3/projects/d27e82e57ecb4829a6c9a42fb7702a78/users/3b5ed0b08e03411981230295b6f36e92/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:03.014170 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.026073 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a166fc-635e-4420-8d8d-670f73f57a7e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.088522 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82009ef6-8293-4c51-a645-7b49ad098114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.089189 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82009ef6-8293-4c51-a645-7b49ad098114 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.089874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82009ef6-8293-4c51-a645-7b49ad098114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.089874 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82009ef6-8293-4c51-a645-7b49ad098114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.090693 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82009ef6-8293-4c51-a645-7b49ad098114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.092278 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82009ef6-8293-4c51-a645-7b49ad098114 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.106756 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1457/2898] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:03.111634 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.124372 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8e49-196c-44aa-88e8-61ed0db14573 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.130580 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.131457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.131809 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.132617 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] PATH_INFO: `/v3/projects/d27e82e57ecb4829a6c9a42fb7702a78/users/3b5ed0b08e03411981230295b6f36e92/roles/a456b12493c0413b825ef135c49a3338` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.134801 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27e82e57ecb4829a6c9a42fb7702a78, user_id=3b5ed0b08e03411981230295b6f36e92, role_id=a456b12493c0413b825ef135c49a3338)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.137560 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.150867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1442/2899] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:03 2022] PUT /identity/v3/projects/d27e82e57ecb4829a6c9a42fb7702a78/users/3b5ed0b08e03411981230295b6f36e92/roles/a456b12493c0413b825ef135c49a3338 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:03.162638 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad011-f40a-448b-b47e-d2eaa4471809 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.162926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad011-f40a-448b-b47e-d2eaa4471809 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.163191 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad011-f40a-448b-b47e-d2eaa4471809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.197550 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fe3ad011-f40a-448b-b47e-d2eaa4471809 None None] MFA Rules not processed for user `3b5ed0b08e03411981230295b6f36e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:03.198803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fe3ad011-f40a-448b-b47e-d2eaa4471809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:03.275340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1458/2900] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:03.287219 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.289285 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:03.355858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67fce-41bd-49e6-991c-b4bb40d0bb65 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.359735 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b46bbe-f0c1-4590-b9c0-251ec1f8aba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.360351 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b46bbe-f0c1-4590-b9c0-251ec1f8aba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.360615 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b46bbe-f0c1-4590-b9c0-251ec1f8aba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.360913 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b46bbe-f0c1-4590-b9c0-251ec1f8aba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.370458 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b46bbe-f0c1-4590-b9c0-251ec1f8aba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.371917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b46bbe-f0c1-4590-b9c0-251ec1f8aba0 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.381811 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1443/2901] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:03.481409 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad011-f40a-448b-b47e-d2eaa4471809 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:03.491709 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad011-f40a-448b-b47e-d2eaa4471809 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:03.495479 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:03.496129 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:03.496404 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:03.496681 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:03.539743 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:03.566378 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:03.569062 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:03.581925 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1459/2902] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:05.481542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11566cd-9187-4081-874b-734aac554459 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:05.482013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11566cd-9187-4081-874b-734aac554459 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:05.482149 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11566cd-9187-4081-874b-734aac554459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:05.503086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a11566cd-9187-4081-874b-734aac554459 None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:05.504364 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a11566cd-9187-4081-874b-734aac554459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:05.555417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:05.576700 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1444/2903] 10.222.0.89 () {58 vars in 1009 bytes} [Tue Aug 30 01:13:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:05.593730 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:05.596862 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:05.695673 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409f22-d071-4cd7-89a8-1bc9390fbefe service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:05.702511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251d15-6772-4b47-a3c1-2cf909fd4f1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:05.703253 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251d15-6772-4b47-a3c1-2cf909fd4f1b service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:05.703601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251d15-6772-4b47-a3c1-2cf909fd4f1b service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:05.703940 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251d15-6772-4b47-a3c1-2cf909fd4f1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:05.716352 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251d15-6772-4b47-a3c1-2cf909fd4f1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:05.719139 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251d15-6772-4b47-a3c1-2cf909fd4f1b service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:05.733005 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1460/2904] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:13:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:13:11.059276 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11566cd-9187-4081-874b-734aac554459 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:11.142221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11566cd-9187-4081-874b-734aac554459 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:11.149495 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:11.150161 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.150442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.150717 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] PATH_INFO: `/v3/users/595bbdfb46444ed1995d3bd4090a104b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.151994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595bbdfb46444ed1995d3bd4090a104b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:11.154007 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:11.235611 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595bbdfb46444ed1995d3bd4090a104b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:11.258837 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595bbdfb46444ed1995d3bd4090a104b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:11.270107 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595bbdfb46444ed1995d3bd4090a104b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:11.271239 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595bbdfb46444ed1995d3bd4090a104b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:11.272670 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595bbdfb46444ed1995d3bd4090a104b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:11.305883 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1445/2905] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:11 2022] DELETE /identity/v3/users/595bbdfb46444ed1995d3bd4090a104b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:11.310332 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.310899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.310899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.342359 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:11.343595 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:11.463657 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1461/2906] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:13:11.473992 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:11.476651 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:11.553893 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6624b12-5379-4b0b-9ba9-b80f92b639c7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:11.558272 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:11.559000 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.559343 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.559680 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.570164 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:11.571629 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:11.582286 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1446/2907] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:11.894375 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:11.896243 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:11.909608 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257333ce-5f42-41f1-93bf-093825bcbca2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:11.918368 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:11.919084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:11.919560 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:11.919939 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] PATH_INFO: `/v3/projects/55b20212981a48398f4ffeb089d9dd25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:11.921124 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b20212981a48398f4ffeb089d9dd25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:11.923447 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:12.001008 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b20212981a48398f4ffeb089d9dd25', 'request_id': 'req-52981691-118a-48d4-94e8-8893b02017c1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.009011 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b20212981a48398f4ffeb089d9dd25', 'request_id': 'req-52981691-118a-48d4-94e8-8893b02017c1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.018632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b20212981a48398f4ffeb089d9dd25', 'request_id': 'req-52981691-118a-48d4-94e8-8893b02017c1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.020575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:12.036965 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] The token cache is being invalidate because project 55b20212981a48398f4ffeb089d9dd25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:12.037403 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.038895 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.041812 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1462/2908] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:11 2022] DELETE /identity/v3/projects/55b20212981a48398f4ffeb089d9dd25 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:12.046744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:12.058090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b89e6d-044c-4eca-8758-beced821ea7e service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:12.070258 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:12.129817 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:12.130867 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:12.131183 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:12.131389 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] PATH_INFO: `/v3/users/3b5ed0b08e03411981230295b6f36e92` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:12.132858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5ed0b08e03411981230295b6f36e92)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:12.134894 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:12.195521 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5ed0b08e03411981230295b6f36e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.210268 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5ed0b08e03411981230295b6f36e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.219946 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5ed0b08e03411981230295b6f36e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.220766 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5ed0b08e03411981230295b6f36e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.221553 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6bb24948-7e35-4dab-b7f0-53998e586f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5ed0b08e03411981230295b6f36e92'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.240782 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1447/2909] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:12 2022] DELETE /identity/v3/users/3b5ed0b08e03411981230295b6f36e92 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:12.614893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:12.617088 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:12.632312 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981691-118a-48d4-94e8-8893b02017c1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:12.747255 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:12.747724 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:12.748063 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:12.748397 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] PATH_INFO: `/v3/projects/d27e82e57ecb4829a6c9a42fb7702a78` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:12.760739 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27e82e57ecb4829a6c9a42fb7702a78)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:12.762746 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:12.868281 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27e82e57ecb4829a6c9a42fb7702a78', 'request_id': 'req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.879881 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27e82e57ecb4829a6c9a42fb7702a78', 'request_id': 'req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.894719 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27e82e57ecb4829a6c9a42fb7702a78', 'request_id': 'req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.909530 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] The token cache is being invalidate because project d27e82e57ecb4829a6c9a42fb7702a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:12.909839 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.911140 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-bb731f8f-29e5-47d7-b0b1-8fbf8eacc547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:12.912894 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1463/2910] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:12 2022] DELETE /identity/v3/projects/d27e82e57ecb4829a6c9a42fb7702a78 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:12.919037 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e7f6b-535d-4abd-9b3c-84cb2734a5fe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:12.919325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e7f6b-535d-4abd-9b3c-84cb2734a5fe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:12.919610 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e7f6b-535d-4abd-9b3c-84cb2734a5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:12.941003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e36e7f6b-535d-4abd-9b3c-84cb2734a5fe None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:12.942252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e36e7f6b-535d-4abd-9b3c-84cb2734a5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:13.033442 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1448/2911] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:13.042798 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ec2b-ee89-4fc4-890e-66fa5098af06 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.043192 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ec2b-ee89-4fc4-890e-66fa5098af06 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.043466 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ec2b-ee89-4fc4-890e-66fa5098af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.066329 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e683ec2b-ee89-4fc4-890e-66fa5098af06 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:13.067615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e683ec2b-ee89-4fc4-890e-66fa5098af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:13.079236 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1464/2912] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:13.081252 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e7f6b-535d-4abd-9b3c-84cb2734a5fe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.092089 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e7f6b-535d-4abd-9b3c-84cb2734a5fe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.097714 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.098420 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.101667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.102241 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.103591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:13.104050 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.107093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.123517 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1449/2913] 10.222.0.89 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:13:13.128167 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ec2b-ee89-4fc4-890e-66fa5098af06 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.138491 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ec2b-ee89-4fc4-890e-66fa5098af06 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.144698 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.145490 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.145773 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.146047 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.146708 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.148643 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.186245 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1465/2914] 10.222.0.89 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/projects => generated 397 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:13.191823 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.209315 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b748d-d1a0-4671-91c7-685405f7d35e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.232179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:13.291059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.292556 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.293204 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.293791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.295074 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.299086 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.323760 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1450/2915] 10.222.0.89 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:13.327915 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.340477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32dbb8-d710-4910-b710-d3c9712a2ca5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.346553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.347228 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.347511 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.347818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.348484 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.350180 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.364861 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1466/2916] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:13:13.366417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.380695 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a54d7-042c-4d89-85a2-11f7a0824d09 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.386147 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6011f-3a0d-4bed-9ed4-076501e8e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.386781 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6011f-3a0d-4bed-9ed4-076501e8e425 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.387059 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6011f-3a0d-4bed-9ed4-076501e8e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.387329 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6011f-3a0d-4bed-9ed4-076501e8e425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.387994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6011f-3a0d-4bed-9ed4-076501e8e425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.389727 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6011f-3a0d-4bed-9ed4-076501e8e425 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.411793 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1451/2917] 10.222.0.89 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:13.412098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.446183 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ed864-91d6-4074-8035-cd323e8476a8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.481379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.481379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.481379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.481379 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] PATH_INFO: `/v3/projects/38eec5d878234771accece5f5ae0b9a3/users/454b8de3ed90423c90aaa652875e68f8/roles/ed49631efea14b8fbf4b884c491e4092` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.516085 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38eec5d878234771accece5f5ae0b9a3, user_id=454b8de3ed90423c90aaa652875e68f8, role_id=ed49631efea14b8fbf4b884c491e4092)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.521512 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.603717 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1467/2918] 10.222.0.89 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:13 2022] PUT /identity/v3/projects/38eec5d878234771accece5f5ae0b9a3/users/454b8de3ed90423c90aaa652875e68f8/roles/ed49631efea14b8fbf4b884c491e4092 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:13.614706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.614972 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.615246 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.650457 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] MFA Rules not processed for user `454b8de3ed90423c90aaa652875e68f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:13.651754 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:13.735997 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1452/2919] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:13.748762 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:13.752951 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:13.784988 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:13.844340 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c88be3-2724-4c0c-a673-17bc361548d7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:13.848615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd8059995549a892fe769eb07dc322', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:13.849306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:13.849628 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:13.849880 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:13.859195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:13.860726 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:13.871955 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1468/2920] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:16.807441 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:16.809245 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:16.886689 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028f8ec-756a-46c8-924d-8f62acd90886 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:16.890576 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba4f9-41d3-427a-9976-2e703fcab672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:16.891184 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba4f9-41d3-427a-9976-2e703fcab672 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:16.891462 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba4f9-41d3-427a-9976-2e703fcab672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:16.891744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba4f9-41d3-427a-9976-2e703fcab672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:16.893936 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-152ba4f9-41d3-427a-9976-2e703fcab672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:16.905052 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba4f9-41d3-427a-9976-2e703fcab672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:16.906567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba4f9-41d3-427a-9976-2e703fcab672 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:16.917358 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1453/2921] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:19.198456 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:19.274216 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42c943-fa49-43c1-86c2-e146267dc848 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:19.283302 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:19.284345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.284707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.285034 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] PATH_INFO: `/v3/users/454b8de3ed90423c90aaa652875e68f8` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.286715 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=454b8de3ed90423c90aaa652875e68f8)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:19.289803 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:19.346588 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454b8de3ed90423c90aaa652875e68f8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.353686 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454b8de3ed90423c90aaa652875e68f8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.362172 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454b8de3ed90423c90aaa652875e68f8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.362781 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454b8de3ed90423c90aaa652875e68f8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.374843 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454b8de3ed90423c90aaa652875e68f8'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:19.384526 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1469/2922] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:13:19 2022] DELETE /identity/v3/users/454b8de3ed90423c90aaa652875e68f8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:19.390175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.390985 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.391170 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.421601 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] MFA Rules not processed for user `ed9887c2ab9944d2a1b8d085a3861143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:19.422838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:19.455363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:19.500834 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1454/2923] 10.222.0.89 () {58 vars in 958 bytes} [Tue Aug 30 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:19.512174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:19.513849 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:19.563148 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:19.581098 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298360d-df9e-48b6-8643-b03381a4c66b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:19.585174 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:19.585813 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.586111 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.586383 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.596685 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:19.598166 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:19.607981 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1470/2924] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:19.912667 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:19.914435 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:19.933152 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901c5c9-2623-44a5-b3a0-bb3286327064 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:19.946865 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:19.947524 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:19.947799 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:19.948063 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] PATH_INFO: `/v3/projects/38eec5d878234771accece5f5ae0b9a3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:19.949328 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38eec5d878234771accece5f5ae0b9a3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:19.951264 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:20.014093 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38eec5d878234771accece5f5ae0b9a3', 'request_id': 'req-1f743c30-ae94-4c03-8e1d-1d820d7a1028'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:20.021563 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38eec5d878234771accece5f5ae0b9a3', 'request_id': 'req-1f743c30-ae94-4c03-8e1d-1d820d7a1028'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:20.027119 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38eec5d878234771accece5f5ae0b9a3', 'request_id': 'req-1f743c30-ae94-4c03-8e1d-1d820d7a1028'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:20.041661 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] The token cache is being invalidate because project 38eec5d878234771accece5f5ae0b9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:13:20.041984 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:20.042992 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:13:20.045467 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1455/2925] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:13:19 2022] DELETE /identity/v3/projects/38eec5d878234771accece5f5ae0b9a3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:23.557019 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:23.558601 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:23.662528 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64738bb-225d-44d6-9664-c32d28276661 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:23.748133 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:23.748772 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:23.749084 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:23.749354 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:23.751237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:23.764540 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:23.766232 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:23.778920 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1471/2926] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:30.037927 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:31.025992 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:31.027745 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:31.096929 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743c30-ae94-4c03-8e1d-1d820d7a1028 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:31.101214 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:31.101836 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:31.102701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:31.102701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:31.104290 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:31.304682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:31.306179 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:31.316888 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1456/2927] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:13:33.773926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=69 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:41.311767 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=50 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:09.074306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.084504 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c3b8a-3346-4baa-91c1-1f14da7ea8fb service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.088346 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.089012 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.089286 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.089553 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.091350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.104134 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.105586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.114209 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1472/2928] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:10.264194 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:10.266220 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:10.278363 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a28d1d-f029-4961-a1e5-00e4211fb094 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:10.282706 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:10.284073 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.284568 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.284965 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.287187 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:10.299439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:10.300966 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:10.310470 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1457/2929] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:11.426044 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.443190 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f866db-a947-4327-85bc-7d9bda7aa0fb service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.447786 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.448677 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.448950 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.449310 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.451120 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.474999 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.477382 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.490941 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1473/2930] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:11.611344 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.614114 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.703273 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b301e8-800c-4af4-aeaa-62f59da09f65 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.710969 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.711838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.711838 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.712199 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.714471 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.728301 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.729567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.740490 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1458/2931] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:21.484775 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=12 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:21.735681 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=38 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:45.321334 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.323617 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:45.346442 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ade79b-8012-43ff-91eb-9a5c81b8bfd6 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:45.355496 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07a551-5e2b-49ba-999f-a3716da1276a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:45.356205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07a551-5e2b-49ba-999f-a3716da1276a service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:45.356631 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07a551-5e2b-49ba-999f-a3716da1276a service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:45.357024 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07a551-5e2b-49ba-999f-a3716da1276a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:45.359817 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a07a551-5e2b-49ba-999f-a3716da1276a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:45.380870 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07a551-5e2b-49ba-999f-a3716da1276a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:45.383231 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07a551-5e2b-49ba-999f-a3716da1276a service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:45.401694 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1474/2932] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:52.598828 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.601637 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:52.642635 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3527e0-62a9-47e8-8f50-71e1eee3c17f service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.656174 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.657659 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.658103 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.659175 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.664121 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:52.692001 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.695542 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.721599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1459/2933] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:55.392593 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.172784 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699a711-6aef-4638-bd95-b6fc4ffe215e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.173684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699a711-6aef-4638-bd95-b6fc4ffe215e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.173684 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699a711-6aef-4638-bd95-b6fc4ffe215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.194647 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9699a711-6aef-4638-bd95-b6fc4ffe215e None None] MFA Rules not processed for user `270eaf34577b45c5a86b999c11d24ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:01.195893 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9699a711-6aef-4638-bd95-b6fc4ffe215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:01.268214 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1475/2934] 10.222.0.89 () {58 vars in 967 bytes} [Tue Aug 30 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:01.322726 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.324200 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:01.401951 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468599-becc-4c8c-9310-d6dbe7c58164 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.408994 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c589ae1e5d3843cd92fe1a125990771d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.410597 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.410885 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.411156 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.421082 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.422691 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.433213 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1460/2935] 10.222.0.89 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:02.239738 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699a711-6aef-4638-bd95-b6fc4ffe215e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.252687 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699a711-6aef-4638-bd95-b6fc4ffe215e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.258566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.259260 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.259707 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.259899 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.262001 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:02.348844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:02.350632 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:02.361810 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1476/2936] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:03.861672 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:03.887625 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017df73-9bd7-4a7c-ba82-317bc45ba64c service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:03.901482 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a6ec078043424aa591043afcc32c3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:03.904325 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.905890 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.907791 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.913046 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:03.947255 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:03.951933 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:03.994221 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1461/2937] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:06.714431 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:06.734740 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147cd59-65a2-4a31-94e5-01f5349c2ca9 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:06.740615 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:06.741299 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:06.741574 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:06.741844 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:06.743943 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:06.761217 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:06.764031 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:06.804837 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1477/2938] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:08.279701 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.290858 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06edbdf-6764-4a9a-a19a-9273b0c67dbd service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.302099 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5007fe05c96e468b9dbc9b22ff1e2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.302736 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.304722 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.305055 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.308033 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.418146 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.420559 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.442859 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1462/2939] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:11.555313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.557039 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:11.599309 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7893-214d-44e8-b874-21fed3a8f9c5 service placement] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:11.607548 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:11.608566 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.609313 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.609779 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] PATH_INFO: `/v3/users/04b9e7e7403f4c8291be10f81f7ebffc` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.611873 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b9e7e7403f4c8291be10f81f7ebffc)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:11.614207 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:11.704767 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b9e7e7403f4c8291be10f81f7ebffc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:11.715620 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b9e7e7403f4c8291be10f81f7ebffc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:11.727587 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b9e7e7403f4c8291be10f81f7ebffc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:11.728768 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b9e7e7403f4c8291be10f81f7ebffc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:11.743082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b9e7e7403f4c8291be10f81f7ebffc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:11.750269 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1478/2940] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:11 2022] DELETE /identity/v3/users/04b9e7e7403f4c8291be10f81f7ebffc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:11.969652 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.987090 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532879-da91-442b-8aac-afad040346b3 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.079567 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:12.087463 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.088153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.088662 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.088792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] PATH_INFO: `/v3/projects/0e0b250cf7f84170a4c4e7d866915a62` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.089917 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0b250cf7f84170a4c4e7d866915a62)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:12.091830 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:12.152574 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0b250cf7f84170a4c4e7d866915a62', 'request_id': 'req-b0fb832f-311f-4f3c-a332-355c61cac49e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.158643 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0b250cf7f84170a4c4e7d866915a62', 'request_id': 'req-b0fb832f-311f-4f3c-a332-355c61cac49e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.165807 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0b250cf7f84170a4c4e7d866915a62', 'request_id': 'req-b0fb832f-311f-4f3c-a332-355c61cac49e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.184546 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] The token cache is being invalidate because project 0e0b250cf7f84170a4c4e7d866915a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:12.185008 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.186053 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.188398 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1463/2941] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:11 2022] DELETE /identity/v3/projects/0e0b250cf7f84170a4c4e7d866915a62 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:12.192366 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:12.193836 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:12.202337 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:12.210926 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba53d-01e3-4054-80a2-7d170e5f06e0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.319575 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.320640 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.321055 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.321534 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] PATH_INFO: `/v3/users/73aa3497d917485896fe7d5fcadcf43c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.323184 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73aa3497d917485896fe7d5fcadcf43c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:12.325237 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:12.410741 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73aa3497d917485896fe7d5fcadcf43c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.425876 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73aa3497d917485896fe7d5fcadcf43c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.439637 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73aa3497d917485896fe7d5fcadcf43c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.446727 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73aa3497d917485896fe7d5fcadcf43c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.471445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73aa3497d917485896fe7d5fcadcf43c'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.479470 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1479/2942] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:12 2022] DELETE /identity/v3/users/73aa3497d917485896fe7d5fcadcf43c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:12.739555 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:12.742013 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:12.766299 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb832f-311f-4f3c-a332-355c61cac49e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.843365 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.844158 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.844682 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.845058 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] PATH_INFO: `/v3/projects/b6c3d583120444fda7b59365a3e7eee5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.847595 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c3d583120444fda7b59365a3e7eee5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:12.850439 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:12.925069 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c3d583120444fda7b59365a3e7eee5', 'request_id': 'req-d7fb6712-8599-45df-8649-b8167889448b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.933591 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c3d583120444fda7b59365a3e7eee5', 'request_id': 'req-d7fb6712-8599-45df-8649-b8167889448b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.940424 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c3d583120444fda7b59365a3e7eee5', 'request_id': 'req-d7fb6712-8599-45df-8649-b8167889448b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.961633 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] The token cache is being invalidate because project b6c3d583120444fda7b59365a3e7eee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:12.961943 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.962650 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:12.964341 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1464/2943] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:12 2022] DELETE /identity/v3/projects/b6c3d583120444fda7b59365a3e7eee5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:16:16.933206 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:16.935581 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:16.960238 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e97b1-a2f1-4733-a668-a1e32ba515e1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:17.032635 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:17.033795 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:17.034283 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:17.034819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] PATH_INFO: `/v3/users/a239f55fb7544a18a28d47320421e24b` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:17.036857 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a239f55fb7544a18a28d47320421e24b)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:17.040586 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:17.070995 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:17.101150 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a239f55fb7544a18a28d47320421e24b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.108889 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a239f55fb7544a18a28d47320421e24b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.118642 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a239f55fb7544a18a28d47320421e24b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.119441 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a239f55fb7544a18a28d47320421e24b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.134636 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a239f55fb7544a18a28d47320421e24b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.141205 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1480/2944] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:16 2022] DELETE /identity/v3/users/a239f55fb7544a18a28d47320421e24b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:17.371855 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:17.373417 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:17.395153 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6712-8599-45df-8649-b8167889448b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:17.412599 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:17.473744 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:17.474720 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:17.475130 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:17.475444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] PATH_INFO: `/v3/projects/5a39388060904cd6ba4affce6db3bdb0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:17.476603 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a39388060904cd6ba4affce6db3bdb0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:17.478548 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:17.530685 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a39388060904cd6ba4affce6db3bdb0', 'request_id': 'req-0f6c8f87-92dc-4b98-9206-e80bf654a99a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.537630 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a39388060904cd6ba4affce6db3bdb0', 'request_id': 'req-0f6c8f87-92dc-4b98-9206-e80bf654a99a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.544288 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a39388060904cd6ba4affce6db3bdb0', 'request_id': 'req-0f6c8f87-92dc-4b98-9206-e80bf654a99a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.560460 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] The token cache is being invalidate because project 5a39388060904cd6ba4affce6db3bdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:17.560792 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.561406 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.563095 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1465/2945] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:17 2022] DELETE /identity/v3/projects/5a39388060904cd6ba4affce6db3bdb0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:17.569315 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:17.571082 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:17.591322 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99485499-7e8d-460d-990b-41ad493071e6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:17.687392 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:17.688038 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:17.688448 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:17.688968 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] PATH_INFO: `/v3/users/900d759561a74f1188790726339bd1f2` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:17.690992 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900d759561a74f1188790726339bd1f2)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:17.694675 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:17.757963 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900d759561a74f1188790726339bd1f2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.765819 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900d759561a74f1188790726339bd1f2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.775195 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900d759561a74f1188790726339bd1f2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.775818 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900d759561a74f1188790726339bd1f2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.789143 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900d759561a74f1188790726339bd1f2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:17.796859 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1481/2946] 10.222.0.89 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:17 2022] DELETE /identity/v3/users/900d759561a74f1188790726339bd1f2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:17.998805 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.000444 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:18.016003 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8f87-92dc-4b98-9206-e80bf654a99a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:18.105137 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed9887c2ab9944d2a1b8d085a3861143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2882d1c77544239bfa08e78d60c1fc1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.105875 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.106382 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.106814 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] PATH_INFO: `/v3/projects/3b7403b035204967a329bc4053027667` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.109062 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7403b035204967a329bc4053027667)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:18.113009 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:18.181191 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7403b035204967a329bc4053027667', 'request_id': 'req-5f425e31-9d62-4079-b125-6b8350a10cc5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.182935 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:18.190312 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7403b035204967a329bc4053027667', 'request_id': 'req-5f425e31-9d62-4079-b125-6b8350a10cc5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.197176 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7403b035204967a329bc4053027667', 'request_id': 'req-5f425e31-9d62-4079-b125-6b8350a10cc5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.212959 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] The token cache is being invalidate because project 3b7403b035204967a329bc4053027667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:18.213566 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.214270 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5f425e31-9d62-4079-b125-6b8350a10cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.215963 dv-cinder-815145-12-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1466/2947] 10.222.0.89 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:17 2022] DELETE /identity/v3/projects/3b7403b035204967a329bc4053027667 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:27.791961 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=73,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.209210 dv-cinder-815145-12-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:51.283445 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:51.285155 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:51.450175 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0b847-3e22-43b6-85af-e257bb4e83b8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:51.518345 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c1f4-9d32-40a2-b66d-af0f50f4640f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a10c7731a84a4589c366c4963c1251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05cd95800453446594f4b9b933e9d41a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:51.518991 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c1f4-9d32-40a2-b66d-af0f50f4640f service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:51.519306 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c1f4-9d32-40a2-b66d-af0f50f4640f service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:51.519568 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c1f4-9d32-40a2-b66d-af0f50f4640f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:51.521659 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0b38c1f4-9d32-40a2-b66d-af0f50f4640f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:51.535956 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38c1f4-9d32-40a2-b66d-af0f50f4640f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:51.538477 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38c1f4-9d32-40a2-b66d-af0f50f4640f service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:51.549350 dv-cinder-815145-12-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1482/2948] 10.222.0.89 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:01.544665 dv-cinder-815145-12-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}